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This  paper  addresses  the  problem  of  steering  a  fleet  of  UAVs  along  desired  paths  while 
meeting  stringent  spatial  and  temporal  constraints.  A  representative  example  is  the  chal¬ 
lenging  mission  scenario  where  the  vehicles  are  tasked  to  cooperatively  execute  collision-free 
maneuvers  and  arrive  at  their  final  destinations  at  the  same  time  (time-critical  operations). 

In  the  setup  adopted,  the  vehicles  are  assigned  nominal  spatial  paths  and  speed  profiles 
along  those.  The  paths  are  then  appropriately  parameterized  and  the  vehicles  are  requested 
to  execute  cooperative  path  following,  rather  than  “open  loop”  trajectory  tracking  maneu¬ 
vers.  This  strategy  yields  robust  behavior  against  external  disturbances  by  allowing  the 
vehicles  to  negotiate  their  speeds  along  the  paths  in  response  to  information  exchanged 
over  the  dynamic  inter-vehicle  communications  network. 

The  paper  addresses  explicitly  the  situation  where  each  vehicle  transmits  its  coordina¬ 
tion  information  to  only  a  subset  of  the  other  vehicles,  as  determined  by  the  communica¬ 
tions  topology.  Furthermore,  we  consider  the  case  where  the  communications  graph  that 
captures  the  underlying  communications  topology  is  disconnected  during  some  interval  of 
time  or  even  fails  to  be  connected  at  all  times.  Conditions  are  given  under  which  the 
complete  time-critical  cooperative  path-following  closed-loop  system  is  stable  and  yields 
convergence  of  a  conveniently  defined  cooperation  error  to  a  neighborhood  of  the  origin. 
Flight  test  results  of  a  coordinated  road  search  mission  demonstrate  the  efficacy  of  the 
multi-UAV  cooperative  control  framework  developed  in  the  paper. 


I.  Introduction 

Unmanned  Aerial  Vehicles  (UAVs)  are  becoming  ubiquitous  and  have  been  playing  an  increasingly  im¬ 
portant  role  in  military  reconnaissance  and  strike  operations,  border  patrol  missions,  forest  fire  detection, 
police  surveillance,  and  recovery  operations,  to  name  but  a  few.  In  simple  applications,  a  single  autonomous 
vehicle  can  be  managed  by  a  crew  using  a  ground  station  provided  by  the  vehicle  manufacturer.  The  exe¬ 
cution  of  more  challenging  missions,  however,  requires  the  use  of  multiple  vehicles  working  in  cooperation 
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Public  reporting  burden  for  the  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington 
VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  a  penalty  for  failing  to  comply  with  a  collection  of  information  if  it 
does  not  display  a  currently  valid  OMB  control  number. 
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to  achieve  a  common  objective.  Representative  examples  of  cooperative  mission  scenarios  are  sequential 
auto-landing  and  coordinated  ground  target  suppression  for  multiple  UAVs.  The  first  refers  to  the  situation 
where  a  fleet  of  UAVs  must  break  up  and  arrive  at  the  assigned  glideslope  point,  separated  by  pre-specified 
safe-guarding  time-intervals.  In  the  case  of  ground  target  suppression,  a  formation  of  UAVs  must  also  break 
up  and  execute  a  coordinated  maneuver  to  arrive  at  pre-defined  positions  over  the  target  at  the  same  time. 

In  both  cases,  only  relative  (rather  than  absolute)  temporal  constraints  are  given  a  priori ,  a  critical  point 
that  needs  to  be  emphasized.  Furthermore,  the  vehicles  must  execute  maneuvers  in  close  proximity  to  each 
other.  In  addition,  as  pointed  out  in  [1,2],  the  flow  of  information  among  vehicles  may  be  severely  restricted, 
either  for  security  reasons  or  because  of  tight  bandwidth  limitations.  As  a  consequence,  no  vehicle  might  be 
able  to  communicate  with  the  entire  formation  and  the  amount  of  information  that  can  be  exchanged  might 
be  limited.  Moreover,  the  topology  of  the  inter-vehicle  communications  network  supporting  the  cooperative 
mission  may  change  over  time.  Under  these  circumstances,  it  is  important  to  develop  cooperative  motion 
control  strategies  that  can  yield  robust  performance  in  the  presence  of  time- varying  communications  networks 
arising  from  temporary  loss  of  communications  links  and  switching  communications  topologies. 

Motivated  by  these  and  similar  problems,  there  has  been  over  the  past  few  years  increasing  interest 
in  the  study  of  multi-agent  system  networks  with  applications  to  engineering  and  science  problems.  The 
range  of  topics  addressed  include  parallel  computing  [3] ,  synchronization  of  oscillators  [4] ,  study  of  collective 
behavior  and  flocking  [5],  multi-system  consensus  mechanisms  [6],  multi- vehicle  system  formations  [7],  coor¬ 
dinated  motion  control  [8],  asynchronous  protocols  [9],  dynamic  graphs  [10],  stochastic  graphs  [10-12],  and 
graph-related  theory  [2,13].  Especially  relevant  are  the  applications  of  the  theory  developed  in  the  area  of 
multi- vehicle  formation  control:  spacecraft  formation  flying  [14],  UAV  control  [15,16],  coordinated  control 
of  land  robots  [8],  and  control  of  multiple  autonomous  underwater  vehicles  (AUVs)  [  7, 18].  In  spite  of  sig¬ 
nificant  progress  in  the  field,  much  work  remains  to  be  done  to  develop  strategies  capable  of  yielding  robust 
performance  of  a  fleet  of  vehicles  in  the  presence  of  complex  vehicle  dynamics,  communications  constraints, 
and  partial  vehicle  failures. 

It  is  against  this  backdrop  of  ideas  that  in  this  paper  we  address  the  problem  of  steering  a  fleet  of  UAVs 
along  desired  paths  while  meeting  stringent  spatial  and  temporal  constraints.  A  representative  example  is 
the  challenging  mission  scenario  where  a  fleet  of  vehicles  is  tasked  to  cooperatively  execute  collision-free 
maneuvers  and  arrive  at  their  final  destinations  at  the  same  time  (time-critical  operations).  In  the  adopted 
setup,  the  vehicles  are  assigned  desired  nominal  paths  and  speed  profiles  along  them.  The  paths  are  then 
appropriately  parameterized,  and  the  vehicles  are  requested  to  execute  cooperative  path  following,  rather 
than  “open-loop”  trajectory  tracking  maneuvers.  This  strategy  yields  robust  performance  in  the  face  of 
external  disturbances  by  allowing  the  vehicles  to  negotiate  their  speeds  along  the  paths  in  response  to 
information  exchanged  over  the  supporting  communications  network.  The  paper  builds  upon  previous  work 
by  the  authors  on  cooperative  path  following  and  extends  it  to  a  very  general  framework  that  allows  for 
the  consideration  of  complex  vehicle  dynamics  and  time-varying  communications  topologies  in  a  rigorous 
mathematical  setting.  The  reader  is  referred  to  [19—24]  and  the  references  therein  for  an  introduction  to 
the  subject  and  a  general  perspective  of  the  circle  of  ideas  that  are  at  the  root  of  the  present  work.  See 
also  [25-31]  and  the  textbook  [32]  for  interesting  and  related  pioneering  work  with  applications  to  marine 
robots. 

The  core  concepts  and  methods  leading  to  the  present  paper  can  be  tracked  back  to  [23],  where  the 
authors  addressed  the  problem  of  steering  a  group  of  vehicles  along  pre-defined  spatial  paths  while  holding 
a  desired  time-varying  geometrical  formation  pattern.  The  solution  proposed  consists  of  two  basic  steps: 
first,  a  path-following  control  law  is  designed  to  drive  each  vehicle  to  its  assigned  path,  with  a  nominal 
speed  profile  that  may  be  path  dependent.  To  this  effect,  each  vehicle  is  made  to  approach  a  virtual  target 
that  moves  along  the  path  according  to  a  conveniently  defined  dynamic  law.  In  the  second  step,  the  speeds 
of  the  virtual  targets  (also  called  coordination  states)  are  adjusted  about  their  nominal  values  so  as  to 
synchronize  their  positions  and  achieve,  indirectly,  vehicle  coordination.  In  the  problem  formulation,  it  was 
explicitly  considered  that  each  vehicle  transmits  its  coordination  state  to  a  subset  of  the  other  vehicles  only, 
as  determined  by  the  communications  topology  adopted.  It  was  shown  that  the  system  that  is  obtained 
by  putting  together  the  path-following  and  coordination  subsystems  can  be  naturally  viewed  as  either  the 
feedback  or  the  cascade  connection  of  the  latter  two.  Using  this  fact  and  recent  results  from  nonlinear 
systems  and  graph  theory,  conditions  were  derived  under  which  the  path-following  and  coordination  errors 
are  driven  to  a  neighborhood  of  zero  in  the  presence  of  communication  losses  and  time  delays.  Two  different 
situations  were  considered.  The  first  one  captures  the  case  where  the  communications  graph  is  alternately 
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connected  and  disconnected  (brief  connectivity  losses).  The  second  reflects  an  operational  scenario  where  the 
union  of  the  communications  graphs  over  uniform  intervals  of  time  remains  connected  (uniformly  connected 
in  mean).  However,  no  time-critical  issues  were  addressed. 

The  extension  of  the  key  concepts  introduced  in  [23]  to  deal  with  time-critical  issues  can  be  found  in  [19,21, 
22].  Especially  relevant  is  the  work  reported  in  [L9],  where  a  general  framework  for  the  problem  of  cooperative 
control  of  multiple  autonomous  vehicles  that  must  operate  under  strict  spatial  and  temporal  constraints  was 
presented.  The  framework  proposed  borrows  from  multiple  disciplines  and  integrates  algorithms  for  path 
generation,  path  following,  time-critical  coordination,  and  C\  adaptive  control  theory  for  fast  and  robust 
adaptation.  Together,  these  techniques  yield  control  laws  that  meet  strict  performance  requirements  in  the 
presence  of  modeling  uncertainties  and  environmental  disturbances. 

The  methodology  proposed  in  [19],  exemplified  for  the  case  of  UAVs,  unfolds  in  three  basic  steps.  First, 
given  a  multiple  vehicle  task,  a  set  of  feasible  trajectories  is  generated  for  all  UAVs  using  an  expedite  method 
that  takes  explicitly  into  account  the  initial  and  the  final  boundary  conditions,  a  general  performance  criterion 
to  be  optimized,  the  simplified  UAV  dynamics,  and  safety  rules  for  collision  avoidance.  The  second  step 
consists  of  making  each  vehicle  follow  its  assigned  path  while  tracking  a  desired  speed  profile.  Path-following 
control  design  is  first  done  at  a  kinematic  level,  leading  to  an  outer-loop  controller  that  generates  pitch-  and 
yaw-rate  commands  to  an  inner-loop  controller.  The  latter  relies  on  off-the-shelf  autopilots  for  angular-rate 
command  tracking,  augmented  with  an  C\  adaptive  output-feedback  control  law  that  guarantees  stability 
and  performance  of  the  complete  system  for  each  vehicle  in  the  presence  of  modeling  uncertainties  and 
environmental  disturbances.  Finally,  in  the  third  step,  the  speed  profile  of  each  vehicle  is  adjusted  about  the 
nominal  speed  profile  derived  in  the  first  step  to  enforce  the  temporal  constraints  that  must  be  met  in  real 
time  in  order  to  coordinate  the  entire  fleet  of  UAVs.  In  this  step,  it  is  assumed  that  the  vehicles  exchange 
information  over  a  fixed  communications  network.  The  results  of  path-following  flight  tests  with  a  single 
vehicle  are  reported;  see  also  [24].  However,  despite  the  large  number  of  simulations  no  actual  flight  tests 
were  done  to  assess  the  efficacy  of  the  developed  cooperative  motion  control  strategy. 

The  extension  of  the  above  introduced  concepts  to  time-varying  communications  networks  was  first 
studied  in  [21].  Related  work  can  also  be  found  in  [20],  which  proposes  a  new  multiple  vehicle  control 
architecture  aimed  at  reducing  the  frequency  at  which  the  information  is  exchanged  among  the  vehicles  by 
incorporating  logic-based  communications.  To  this  effect,  the  authors  borrow  from  and  expand  some  of 
the  key  ideas  exposed  in  [33,34],  where  decentralized  controllers  for  distributed  systems  were  derived  by 
using,  for  each  system,  its  local  state  information  together  with  estimates  of  the  states  of  the  systems  that 
it  communicates  with.  In  [20],  a  key  constraint  was  introduced:  each  system  (vehicle)  is  only  allowed  to 
communicate  with  a  set  of  immediate  neighbors.  With  the  scheme  adopted,  each  vehicle  decides  when  to 
transmit  information  to  the  neighbors  by  comparing  its  actual  state  with  its  estimate  “as  perceived”  by  the 
neighboring  systems,  and  transmitting  data  when  the  “difference”  between  the  two  exceeds  a  certain  level. 
As  a  consequence,  the  systems  communicate  at  discrete  instants  of  time,  asynchronously. 

The  present  paper  borrows  key  ideas  and  design  methods  from  previous  work  by  the  authors  on  cooper¬ 
ative  path  following  and  extends  them  to  a  very  general  setting  that  allows  for  the  consideration  of  complex 
vehicle  dynamics,  time- critical  constraints,  and  time-varying  communications  topologies.  From  a  technical 
point  of  view,  the  paper  departs  substantially  from  previous  published  work  in  three  key  aspects: 

( i )  it  puts  forward  a  new  algorithm  for  path  following  in  3-D  space  that  overcomes  the  problems  that  arise 
from  using  local  parameterizations  of  the  rotation  matrices; 

(ii)  it  offers  a  new  proof  of  convergence  of  the  relevant  variables  involved  in  cooperative  path  following  that 
significantly  simplifies  the  one  summarized  in  [21]  and  extends  it  to  the  case  where  the  speed  profiles 
of  the  different  vehicles  along  their  paths  are  arbitrary  but  meet  desired  geometrical  constraints.  In 
this  setup,  the  communications  graph  that  captures  the  underlying  communications  network  topology 
is  allowed  to  be  disconnected  during  some  interval  of  time  or  may  even  fail  to  be  connected  at  all 
times.  It  is  shown  that  if  the  connectivity  of  the  communications  graph  satisfies  a  certain  persistency 
of  excitation  (PE)-like  condition,  then  the  UAVs  “reach  consensus”  in  the  sense  that  a  conveniently 
defined  cooperation  error  converges  to  a  neighborhood  of  the  origin;  and 

(Hi)  finally,  flight  test  results  of  a  coordinated  road  search  mission  that  exploits  the  multi-UAV  cooperative 
control  framework  developed  in  the  paper  demonstrate  the  efficacy  of  the  developed  algorithms. 

This  paper  is  organized  as  follows.  Section  II  formulates  the  time-critical  cooperative  path-following 
problem,  describes  the  kinematics  of  the  systems  of  interest,  and  introduces  a  set  of  assumptions  and  limi- 
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tations  on  the  supporting  communications  network.  Section  III  presents  a  path-following  control  algorithm 
for  UAVs  in  3-D  space.  Section  IV  derives  a  strategy  for  time-critical  cooperative  path  following  of  multiple 
UAVs  in  the  presence  of  time- varying  communications  networks  that  relies  on  the  adjustment  of  the  desired 
speed  profile  of  each  vehicle.  Section  V  addresses  the  stability  and  convergence  properties  of  the  combined 
coordination  and  path-following  systems.  Section  VI  presents  actual  flight  test  results  performed  in  Camp 
Roberts,  CA.  Finally,  Section  VII  summarizes  the  key  results  and  contains  the  main  conclusions. 


Notation 

Throughout  the  paper  we  use  the  following  notation.  {w}f  is  used  to  denote  the  vector  v  resolved  in 
frame  J- ;  {ej-F  represents  the  versor  e  resolved  in  frame  lofi/fz  denotes  the  angular  velocity  of  frame  J-l 
with  respect  to  frame  T2\  the  rotation  matrix  from  frame  J-l  to  frame  J- 2  is  represented  by  Rpf ;  and  v]f 
indicates  that  the  time-derivative  of  vector  v  is  taken  in  frame  J- .  Moreover,  unless  otherwise  noted,  ||-||  is 
used  for  both  the  2-norm  of  a  vector  and  the  induced  2-norm  of  a  matrix. 

II.  Time-Critical  Cooperative  Path  Following:  Problem  Formulation 

This  section  provides  a  rigorous  formulation  of  the  problem  of  time-critical  cooperative  path-following 
control  for  multiple  UAVs  in  3-D  space,  in  which  a  fleet  of  UAVs  is  tasked  to  converge  to  and  follow  a  set  of 
desired  feasible  paths  so  as  to  meet  spatial  and  temporal  constraints.  We  also  introduce  a  set  of  assumptions 
and  limitations  on  the  supporting  communications  network. 

We  note  that  the  problem  of  cooperative  path  generation  is  not  addressed  in  this  paper.  In  fact,  we 
assume  that  a  set  of  desired  3-D  time  trajectories  &d,i(td)  '■  K.  — >  R3,  conveniently  parameterized  by  a  single 
time  variable  td  £  [0,  f*,],  are  known  for  all  the  n  UAVs  involved  in  a  cooperative  mission.  The  variable  td 
represents  a  desired  mission  time  (distinct  from  the  actual  mission  time  that  evolves  as  the  mission  unfolds) , 
with  t *d  being  the  desired  mission  duration.  For  a  given  td,  &d,i(td)  defines  the  desired  position  of  the 
*th  UAV  td  seconds  after  the  initiation  of  the  cooperative  mission.  From  these  time  trajectories,  spatial 
paths  Pd,i(r^ti)  :  R  — >  M3  and  the  corresponding  desired  speed  profiles  Vd,i(td)  :  M  — ►  R  can  be  easily  derived 
for  all  the  UAVs.  For  convenience,  we  parameterize  each  spatial  path  by  its  path  length  7y,;  £  [0 ,  •£/,;],  where 
£fi  denotes  the  total  length  of  the  ith  path,  whereas  the  desired  speed  profiles  are  parameterized  by  the 
desired  mission  time  td ■  It  is  assumed  that  both  the  paths  and  the  speed  profiles  satisfy  collision- avoidance 
constraints  as  well  as  appropriate  boundary  and  feasibility  conditions,  such  as  those  imposed  by  the  physical 
limitations  of  the  UAVs.  It  is  further  assumed  that  the  rate  and  speed  commands  required  to  follow  the  paths 
and  achieve  time-coordination  do  not  result  in  the  UAVs  operating  outside  their  normal  flight  envelope  and  do 
not  lead  to  internal  saturation  of  the  onboard  autopilots.  The  problem  of  generation  of  feasible  collision-free 
trajectories  for  multiple  cooperative  autonomous  vehicles  is  described  in  detail  in  [35]. 

II. A.  Path  Following  for  a  Single  UAV 

Pioneering  work  in  the  area  of  path  following  can  be  found  in  [36] ,  where  an  elegant  solution  to  the  problem 
was  presented  for  a  wheeled  robot  at  the  kinematic  level.  In  the  setup  adopted,  the  kinematic  model  of  the 
vehicle  was  derived  with  respect  to  a  Frenet-Serret  frame  moving  along  the  path,  while  playing  the  role  of  a 
virtual  target  vehicle  to  be  tracked  by  the  real  vehicle.  The  origin  of  the  Frenet-Serret  was  placed  at  the  point 
on  the  path  closest  to  the  real  vehicle.  This  work  spurred  a  great  deal  of  activity  in  the  literature  addressing 
the  path- following  control  problem.  Of  particular  interest  is  the  work  reported  in  [37],  in  which  the  authors 
reformulated  the  setup  used  in  [36]  and  derived  a  feedback  control  law  that  steers  the  dynamic  model  of 
a  wheeled  robot  along  a  desired  path  and  overcomes  stringent  initial  condition  constraints  present  in  [36]. 
The  key  to  the  algorithm  in  [37]  is  to  explicitly  control  the  rate  of  progression  of  the  virtual  target  along  the 
path.  This  effectively  creates  an  extra  degree  of  freedom  that  can  be  exploited  to  avoid  singularities  that 
occur  when  the  distance  to  the  path  is  not  well  defined. 

The  solution  to  the  path-following  problem  described  in  the  present  paper  extends  to  the  3-D  case  the 
algorithm  presented  in  [37],  and  relies  on  the  insight  that  a  UAV  can  follow  a  given  path  using  only  its 
attitude,  thus  leaving  its  speed  as  an  extra  degree  of  freedom  to  be  used  at  the  coordination  level.  The 
key  idea  of  the  algorithm  is  to  use  the  vehicle’s  attitude  control  effectors  to  follow  a  virtual  target  vehicle 
running  along  the  path.  To  this  effect,  following  the  approach  adopted  in  [37],  we  introduce  a  frame  attached 
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Figure  1.  Following  a  virtual  target  vehicle.  Problem  geometry. 


to  this  virtual  target  and  define  a  generalized  error  vector  between  this  moving  coordinate  system  and  a 
frame  attached  to  the  actual  vehicle.  With  this  setup,  the  path-following  control  problem  is  reduced  to 
that  of  driving  this  generalized  error  vector  to  zero  by  using  only  the  UAV’s  attitude  control  effectors,  while 
following  an  arbitrary  feasible  speed  profile.  Next,  we  characterize  the  dynamics  of  the  kinematic  errors 
between  the  *th  vehicle  and  its  virtual  target. 

Figure  1  captures  the  geometry  of  the  problem  at  hand.  Let  pd{-)  be  the  desired  path  assigned  to  one 
of  the  UAVs,  and  let  £f  be  its  total  length.  Let  X  denote  an  inertial  reference  frame  {eu ,  e/g,  e/3},  and  let 
Pi(t)  be  the  position  of  the  center  of  mass  Q  of  the  UAV  in  this  inertial  frame.  Further,  let  P  be  an  arbitrary 
point  on  the  desired  path  that  plays  the  role  of  the  virtual  target,  and  let  Pd{£)  denote  its  position  in  the 
inertial  frame.  Here  £  £  [0  ,£/]  is  a  free  length  variable  that  defines  the  position  of  the  virtual  target  vehicle 
along  the  path.  In  the  setup  adopted,  the  total  rate  of  progression  of  the  virtual  target  along  the  path  is  an 
extra  design  parameter.  This  approach  is  in  striking  contrast  with  the  strategy  used  in  the  path-following 
algorithm  introduced  in  [36],  where  P  is  defined  as  the  point  on  the  path  that  is  closest  to  the  vehicle. 
Endowing  the  point  P  with  an  extra  degree  of  freedom  is  the  key  to  the  path-following  algorithm  presented 
in  [37]  and  its  extension  to  the  3-D  case  described  in  this  paper. 

For  our  purposes,  it  is  convenient  to  define  a  parallel  transport  frame  P  attached  to  the  point  P  on 
the  path  and  characterized  by  the  orthonormal  vectors  {t(£),  ni(£),  fi2(£)},  which  satisfy  the  following  frame 
equations  [38,39] 


fw  ' 

0 

ki(£) 

k2(£) 

'  t(£)  ' 

= 

-h(£) 

0 

0 

ni(£) 

O-I  a 

Hi?1 

1 _ 

-k2(£) 

0 

0 

_  n2{£)  _ 

where  k±(£ )  and  k2{£)  are  related  to  the  polar  coordinates  of  curvature  k(£)  and  torsion  t{£)  as 

k(£)  =  (kl(£)  +  kl{£)Y  ,  t{£)  =  ^tan-1  ' 

The  vectors  {f,  711,712}  define  an  orthonormal  basis  for  P ,  in  which  the  unit  vector  t{£)  defines  the  tangent 
direction  to  the  path  at  the  point  determined  by  l1  while  n\{£)  and  n2(£)  define  the  normal  plane  perpen¬ 
dicular  to  t(£).  We  note  that,  unlike  the  Frenet-Serret  frame,  this  moving  frame  is  well  defined  when  the 
path  has  a  vanishing  second  derivative.  This  orthonormal  basis  can  be  used  to  construct  the  rotation  matrix 
Rp(£)  =  [{ t{£)}i ;  {ni (£)}/;  {^(f)}/]  from  P  to  X.  Furthermore,  the  angular  velocity  of  P  with  respect  to  I, 

5  of  36 


American  Institute  of  Aeronautics  and  Astronautics 


resolved  in  J~,  can  be  easily  expressed  in  terms  of  the  parameters  ki(£)  and  k2(i)  as 


{u)F/i}f=  0,  —]<&(£)£,  ki(£)l 


Let  pF{t)  be  the  position  of  the  vehicle’s  center  of  mass  Q  in  the  parallel  transport  frame,  and  let  xF(t), 
yF(t ),  and  zF{t)  be  the  components  of  the  vector  pF(t)  with  respect  to  the  basis  {t, Hi, 712},  that  is, 


{pf}f 


xF,  Vf, 


Finally,  let  W  denote  a  vehicle-carried  velocity  frame  {wi,W2,W3}  with  its  origin  at  the  UAV  center  of 
mass  and  its  x-axis  aligned  with  the  velocity  vector  of  the  UAV.  The  2-axis  is  chosen  to  lie  in  the  plane  of 
symmetry  of  the  UAV,  and  the  y-axis  is  determined  by  completing  the  right-hand  system.  In  this  paper, 
q(t)  and  r(t)  are  the  y- axis  and  2-axis  components,  respectively,  of  the  vehicle’s  rotational  velocity  resolved 
in  the  W  frame.  With  a  slight  abuse  of  notation,  q(t )  and  r(f)  will  be  referred  to  as  pitch  rate  and  yaw  rate , 
respectively,  in  the  W  frame. 

With  the  above  notation,  we  next  characterize  the  kinematic  error  dynamics  of  the  UAV  with  respect  to 
the  virtual  target.  We  start  by  deriving  the  position-error  dynamics.  For  this  purpose,  we  note  that 


Pi  =Pd{£)  +  PF, 


from  which  it  follows  that 

pI)I  =  £i  +  ujf/ j  x  pF  +  pF)F, 

where  •]/  and  -]F  are  used  to  indicate  that  the  derivatives  are  taken  in  the  inertial  and  parallel  transport 
frames,  respectively.  Because 

Pl]l  =vw1, 

where  v(t)  denotes  the  magnitude  of  the  UAV’s  ground  velocity  vector,  the  path-following  kinematic  position- 
error  dynamics  of  the  UAV  with  respect  to  the  virtual  target  can  be  written  as 

Pf]f  =  —  £t  —  COF/jXpF  +  VW\.  (1) 


To  derive  the  attitude-error  dynamics  of  the  UAV  with  respect  to  its  virtual  target,  we  first  introduce 
an  auxiliary  frame  T>  {b3F),  b3Ff\,  which  will  be  used  to  shape  the  approach  attitude  to  the  path  as  a 
function  of  the  “cross-track”  error  components  yF  and  zF.  The  frame  V  has  its  origin  at  the  UAV  center  of 
mass  and  the  vectors  b1F)(t),  l>2D(t),  and  b3F)(t)  are  defined  as 


bm  = 


a  dt  -  yFfii  -  zFn2 


^  +  yl  +  zlY 


b2D  = 


a  VFt  +  dni 


(d2  +  y2Fy 


b3D  =  bin  x  b 


?2D  ■ 


(2) 


with  d  being  a  (positive)  constant  characterizing  distance.  The  basis  vector  bioit)  defines  the  desired 
direction  of  the  UAV’s  velocity  vector.  Clearly,  when  the  vehicle  is  far  from  the  desired  path,  the  vector  biD{t) 
becomes  perpendicular  to  t(£).  As  the  vehicle  comes  closer  to  the  path  and  the  cross-track  error  becomes 
smaller,  then  biF(t)  tends  to  f(£).  The  rotation  matrix  RF{t)  £  SO(3)  is  given  by 


R 


F  _ 
D  ~ 


d 

(<P+y%+z%)1 

-VF 

(di+vl+zl)  i 


-ZF 

{d2+y2F+zZF)i 


VF 

{<PWF)% 

d 

(<P+yl)% 

0 


_ Zpd _ 

(d2+y%  +  zl)i  (d*+y%)i 

_ -VFZ F _ 

(d*+yj,  +  zl,)i  (cP+y&i 
(d2+y2p)i  ^ 

(d?+y2F+zj,)i 


Next,  let  R(t)  £  SO (3)  be  the  rotation  matrix  from  W  to  T> ,  that  is, 


TD  tdD  _  r>U  Tit  _ 

—  Jl'W  —  -FlTP  JtW  — 


D 


( Rd)tR 


F 

W  5 


and  define  the  real- valued  error  function  on  SO (3) 


*{R)  =  ^tr  [(i3  -  njnfl)  ( 


I3  -R) 


(3) 
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where  11#  is  defined  as 


nR  = 


o  1  o 
0  0  1 


The  function  'F(.R)  in  (3)  can  be  expressed  in  terms  of  the  entries  of  R(t)  as 

*(R)  =  \  (l  -  Ai)  , 

where  Rn(t)  denotes  the  (1,1)  entry  of  R(t).  Therefore,  R )  is  positive-definite  about  i?n  =  1.  We  note 
that  Rn  =  1  corresponds  to  the  situation  where  the  velocity  vector  of  the  UAV  is  aligned  with  the  basis 
vector  bir>(t),  which  defines  the  desired  attitude. 

The  attitude  kinematics  equation 


where  (-)A  :  R3  — » 
of  4 '(R),  given  by 


R  =  Riy  =  Rw  ({ uw/d}w )  =  R  ({ uw/d}w )  > 

SO (3)  denotes  the  hat  map  (see  Appendix  A),  can  be  used  to  derive  the  time  derivative 


'i'(-R)  -  ~2tr  (I3  -  njn#)  r  (|%/d}w) 


Property  (45)  of  the  hat  map  (see  Appendix  A)  leads  to 

« KR)  =  \  (^((h-iiliiR)R-RT  (i3-nluR)y^j  {ojw/d }w, 


where  (-)v  :  S0(3) 


denotes  the  vee  map ,  which  is  defined  as  the  inverse  of  the  hat  map.  Moreover, 


since  the  first  component  of  ^(I3  —  Iljn#)  R  —  RT  (l3  —  II Jll#)^  is  equal  to  zero,  we  can  also  write 

*(R)  =  \  ^(h-nlnR)R-RT  (i3~nTRnR)y^  uTRu R{tow/D}w 


n#  ^(i3  —  njn#)  r  —  rt  (i3  —  iiJiir)^  ^  n r{uW/d}w  ■ 


(4) 


-n  trur 


Next,  we  define  the  attitude  error  e^(t)  as 

ek  =  1 n#  ((i3  -  njn#)  r  -  rt  (i3 

which  allows  to  rewrite  (4)  in  the  more  compact  form 

'S’(R)  =  ■  (n r{u)W/d}w)  ■ 

We  note  that  the  attitude  error  e#(i)  can  also  be  expressed  in  terms  of  the  entries  of  R(t)  as 

_  1  r  - 

eR  —  Rl3  >  —Rl2 

and  therefore,  within  the  region  where  \I/( R )  <  1,  we  have  that  if  ||e#||  =  0,  then  Rn  =  1.  Finally,  noting 
that  {low/f}w  can  be  expressed  as 

{ww/d}w  =  {uw/i}w  —  RT  (-R#{wf/j}f  +  {'jJd/f}d)  1 


we  obtain 


i>{R)  =  ek- 


—  II rRt  (Rr{u>f/i}f  +  {ud/f}d) 


(5) 
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This  equation  describes  the  path-following  kinematic  attitude-error  dynamics  of  the  frame  W  with  respect 
to  the  frame  T>.  The  path-following  kinematic-error  dynamics  Qe  can  now  be  obtained  by  combining  (1) 
and  (5),  yielding 


Pf)f  =  —  it  —  ejpjj  x  pf  +  vwi, 


*(R)  =  ej 


—  IIr.Rt  (Rf{ujf/i}f  +  {ud/f}d) 


(6) 


In  the  kinematic-error  model  (6),  q[t)  and  r(t)  play  the  role  of  control  inputs,  while  the  rate  of  progression  £(t) 
of  the  point  P  along  the  path  becomes  an  extra  variable  that  can  be  manipulated  at  will.  At  this  point,  we 
formally  define  the  path- following  generalized  error  vector  xpf  (t)  as 


A 

Xpf  — 


Pf  ■ 


Notice  that,  within  the  region  where  ’I'(.R)  <  1,  if  xpf  =  0,  then  both  the  path-following  position  error  and 
the  path-following  attitude  error  are  equal  to  zero,  that  is,  pf  =  0  and  i?n  =  0. 

Using  the  above  formulation,  and  given  a  spatially  defined  feasible  path  pd{-),  we  now  define  the  problem 
of  path  following  for  a  single  vehicle. 


Definition  1  (Path-Following  Problem  (PFP))  For  a  given  UA  V,  design  feedback  control  laws  for  pitch 
rate  q(t),  yaw  rate  r(t ),  and  rate  of  progression  £(t)  of  the  virtual  target  along  the  path  such  that  all  closed- 
loop  signals  are  bounded  and  the  path-following  generalized  error  vector  xpf(t )  converges  to  a  neighborhood 
of  the  origin,  regardless  of  what  the  temporal  speed  assignment  of  the  mission  is  (as  long  as  it  is  physically 
feasible). 


Stated  in  simple  terms,  the  problem  above  amounts  to  designing  feedback  laws  so  that  a  UAV  converges 
to  and  remains  inside  a  tube  centered  on  the  desired  path  curve  assigned  to  this  UAV,  for  an  arbitrary  speed 
profile  (subject  to  feasibility  constraints). 


II. B.  Time-Critical  Coordination  and  Network  Model 

To  enforce  the  temporal  constraints  that  must  be  met  in  real  time  to  coordinate  the  entire  fleet  of  vehicles, 
the  speed  profile  of  each  vehicle  is  adjusted  based  on  coordination  information  exchanged  among  the  UAVs 
over  a  time-varying  communications  network.  To  this  effect,  an  appropriate  coordination  variable  needs  to 
be  defined  for  each  vehicle  that  captures  the  objective  of  the  cooperative  mission,  in  our  case,  simultaneous 
arrival  of  all  the  UAVs  at  their  final  destinations. 

For  this  purpose,  we  start  by  defining  l'd  i( td )  as  the  desired  normalized  curvilinear  abscissa  of  the  ith  UAV 
along  its  corresponding  path  at  the  desired  mission  time  td,  which  is  given  by 

td 

C,i(td)  ~  Jj:  J  vd,i{°t)  dcjt ,  (7) 

o 

with  £fi  and  Vd,%( ■)  being,  respectively,  the  length  of  the  path  and  the  desired  speed  profile  corresponding 
to  the  *th  UAV.  The  trajectory-generation  algorithm  ensures  that  the  desired  speed  profiles  Vd,i( •)  satisfy 
feasibility  conditions,  which  implies  that  the  following  bounds  hold  for  all  vehicles: 

0  ^  Unin  if  TU.zmin  ^d,i(*)  Vd,i  max  fi:  Unax  ,  t  —  1,  ...  ,77.,  (8) 

where  vm,n  and  umax  denote,  respectively,  the  minimum  and  maximum  operating  speeds  of  the  UAV,  while 
Vd, %  min  and  Vdf  max  denote  lower  and  upper  bounds  on  the  desired  speed  profile  for  the  ith  UAV.  From  the 
definition  of  t'd  td )  and  the  bounds  in  (8),  it  follows  that  £'d  4( td )  is  a  strictly  increasing  continuous  function 
of  td  mapping  [0,  t*d ]  into  [0, 1],  and  satisfying  £'d  ^0)  =  0  and  l'd  =  1.  We  also  define  iji  :  [0, 1]  — >  [0,  td] 
to  be  the  inverse  function  of  i'd  4( td ),  td  S  [0,^].  Clearly,  rji(-)  is  also  a  strictly  increasing  continuous  function 
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of  its  argument.  Then,  letting  t’ff)  be  the  normalized  curvilinear  abscissa  at  time  t  of  the  zth  virtual  target 
vehicle  running  along  its  path,  defined  as 


m  = 


(■fi 


where  £i(t)  £  [0 ,£fi\  was  introduced  in  the  previous  section,  we  define  the  time-dependent  variables 


£i(t)  =  Viit'M)  >  i  =  1, . . .  ,n . 


(9) 


From  this  definition,  it  follows  that  £(f)  £  [0,t])],  and  therefore  this  variable  can  be  seen  as  a  virtual  time 
that  characterizes  the  status  of  the  mission  for  the  zth  UAV  at  time  t  in  terms  of  the  desired  mission  time  td- 

We  note  that,  for  any  two  vehicles  i  and  j,  if  (t)  =  £j(t)  =t'd  at  a  given  time  t,  then  f'ff)  =  £'d  ftj) 
and  £j(t)  =  £dj(t'd),  which  implies  that  at  time  t  the  target  vehicles  corresponding  to  UAVs  i  and  j  have 
the  desired  relative  position  along  the  path  at  the  desired  mission  time  t'd.  Clearly,  if  £j(t)  =  £j(t)  for  all 
t  >  0,  then  the  zth  and  jth  virtual  target  vehicles  maintain  desired  relative  position  along  the  path  at  all 
times  and,  in  particular,  these  two  target  vehicles  arrive  at  their  final  destinations  at  the  same  time,  which 
does  not  necessarily  correspond  to  the  desired  mission  duration  t *d.  Also,  in  the  case  of  collision  avoidance 
in  time  (see  [35]),  if  £j(i)  =  £j(t)  for  all  t  >  0,  then  the  solution  to  the  path-generation  problem  ensures  that 
the  virtual  targets  i  and  j  do  not  collide.  Moreover,  if  the  zth  virtual  target  travels  at  the  desired  speed  for 
all  time  in  the  interval  [0,  t],  that  is,  U{t)  =  Vd,i(r)  for  all  r  £  [0,  t\,  then  we  have  that  £i(r)  =  for  all 

t  £  [0,  t],  which  implies  that  £j(r)  =  r  (or  equivalently,  that  £z(t)  =  1)  for  all  r  £  [0,  t].  This  set  of  properties 
makes  the  variables  tf  (t)  an  appropriate  metric  for  vehicle  coordination,  and  therefore  we  will  refer  to  them 
as  coordination  states.  We  notice  that  the  use  of  these  specific  coordination  variables  is  motivated  by  the 
work  in  [22], 

To  meet  the  desired  temporal  assignments  of  the  cooperative  mission,  these  coordination  states  are  to 
be  exchanged  among  the  UAVs  over  the  supporting  communications  network.  Next,  we  use  tools  and  facts 
from  algebraic  graph  theory  to  model  the  information  exchange  over  the  time-varying  network  as  well  as  the 
constraints  imposed  by  the  communications  topology.  The  reader  is  referred  to  [40]  for  key  concepts  and 
details  on  algebraic  graph  theory. 

First,  in  order  to  account  for  the  communications  constraints  imposed  by  this  inter-vehicle  network, 
we  assume  that  the  zth  UAV  can  only  exchange  information  with  a  neighboring  set  of  vehicles,  denoted 
here  by  Gi.  We  also  assume  that  the  communications  between  two  UAVs  is  bidirectional  and  that  the 
information  is  transmitted  continuously  with  no  delays.  Moreover,  since  the  flow  of  information  among 
vehicles  may  be  severely  restricted,  either  for  security  reasons  or  because  of  tight  bandwidth  limitations, 
we  impose  the  constraint  that  each  vehicle  only  exchanges  its  coordination  state  £j(t)  with  its  neighbors. 
Finally,  we  assume  that  the  connectivity  of  the  communications  graph  T(t)  that  captures  the  underlying 
bidirectional  communications  network  topology  of  the  fleet  at  time  t  satisfies  the  persistency  of  excitation 
(PE)-like  condition 


1  1 
nT 


t+T 

J  Q  L(t)  QT dr  >  p  I„_i 


for  all  f  >  0  , 


(10) 


where  L(t)  £  RraX71  is  the  Laplacian  of  the  graph  T(t),  and  Q  is  an  (n  —  1)  x  n  matrix  such  that  Q ln  =  0 
and  QQT  =  I„_i,  with  ln  being  the  vector  in  R”  whose  components  are  all  1.  The  parameters  T,  fi  >  0 
characterize  the  quality  of  service  (QoS)  of  the  communications  network,  which  in  the  context  of  this  paper 
represents  a  measure  of  the  level  of  connectivity  of  the  communications  graph.  We  note  that  the  PE- 
like  condition  (10)  requires  only  the  communications  graph  T(t)  to  be  connected  in  an  integral  sense,  not 
pointwise  in  time.  In  fact,  the  graph  may  be  disconnected  during  some  interval  of  time  or  may  even  fail  to 
be  connected  for  the  entire  duration  of  the  mission.  Similar  type  of  conditions  can  be  found,  for  example, 
in  [41]  and  [6]. 

Using  the  formulation  above,  we  next  define  the  problem  of  time-critical  cooperative  path  following  for  a 
fleet  of  n  UAVs. 


Definition  2  (Time-Critical  Cooperative  Path- Following  Problem  (TC-CPFP))  Given  a  fleet  of 
n  vehicles  supported  by  an  inter-vehicle  communications  network  and  a  set  of  desired  3-D  time  trajecto¬ 
ries  &d,i(td),  design  feedback  control  laws  for  pitch  rate  q(t),  yaw  rate  r{t),  and  speed  v(t)  such  that 

1.  all  closed-loop  signals  are  bounded; 
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2.  for  each  vehicle  i,  i  £  {1  the  path-following  generalized  error  vector  xpf^(t)  converges  to  a 

neighborhood  of  the  origin;  and 

3.  for  each  pair  of  vehicles  i  and  j,  i,j  £  {1 . . .  ,n},  the  coordination  error  |£i(£)  —  £j(t)|  converges  to  a 
neighborhood  of  the  origin ,  guaranteeing  (quasi-) simultaneous  time  of  arrival  and  ensuring  collision-free 
maneuvers. 

At  this  point,  we  stress  that  in  this  paper  we  address  the  design  of  control  algorithms  for  path  following 
and  time  coordination  yielding  robust  performance  of  a  fleet  of  UAVs  executing  various  time-critical  coop¬ 
erative  missions.  These  control  algorithms  are  to  be  seen  as  guidance  outer-loop  controllers  that  provide 
reference  commands  to  inner-loop  autopilots  stabilizing  the  UAV  dynamics  and  providing  angular-rate  as 
well  as  speed  tracking  capabilities.  This  inner-outer  loop  approach  simplifies  the  design  process  and  affords 
the  designer  a  systematic  approach  to  seamlessly  tailor  the  algorithms  for  a  very  general  class  of  UAVs  that 
come  equipped  with  inner-loop  commercial  autopilots.  In  the  next  section,  we  present  a  set  of  assumptions 
on  the  inner  closed-loop  performance  of  the  UAVs  with  their  autopilots,  which  will  be  useful  to  analyze  the 
convergence  properties  of  the  path-following  and  coordination  control  laws  developed  later  in  the  paper. 

II. C.  Unmanned  Aerial  Vehicle  with  Autopilot 

As  mentioned  in  the  previous  section,  this  paper  addresses  the  design  of  outer-loop  control  laws  for  path 
following  and  time-critical  cooperation  of  a  fleet  of  small  tactical  UAVs.  The  design  of  inner-loop  onboard 
autopilots  that  are  capable  of  tracking  reference  commands  generated  by  outer-loop  controllers  and  providing 
uniform  performance  across  the  flight  envelope  is  beyond  the  scope  of  the  work  presented  here.  Nevertheless, 
it  is  important  to  determine  performance  requirements  for  the  onboard  autopilot  that  ensure  that  the  mission 
is  successfully  accomplished  by  the  fleet  of  vehicles.  To  this  effect,  and  for  the  purpose  of  this  paper,  we  will 
assume  that  each  UAV  is  equipped  with  an  onboard  autopilot  designed  to  stabilize  the  UAV  and  to  provide 
angular-rate  as  well  as  speed  tracking  capabilities.  In  particular,  we  make  the  assumption  that  the  onboard 
autopilots  ensure  that  each  UAV  is  able  to  track  bounded  pitch-rate  and  yaw-rate  commands,  denoted  here 
by  qc(t)  and  rc(t),  with  guaranteed  performance  bounds  "fq  and  7r.  Stated  mathematically, 

kc(t)  ~  q(t)\  <  7g,  Vt>0, 

| rc(t)  -  r(t) |  <  jr  ,  V  t  >  0  . 

Similarly,  we  assume  that,  if  the  speed  commands  vc(t)  satisfy  the  bounds 

^min  A  'Uc(t)  Vmax  j  V  T  £  [0,  t\  ,  (12) 

then  the  autopilots  ensure  that  each  UAV  tracks  its  corresponding  speed  command  with  guaranteed  perfor¬ 
mance  bound  7„: 

|i>c(t)  —  v(t)|  <  7„  ,  V  r  6  [0,f].  (13) 

The  bounds  7q,  jr,  and  7„  characterize  thus  the  level  of  tracking  performance  that  the  inner-loop  autopilot  is 
able  to  provide.  These  bounds  will  be  used  later  in  the  paper  to  derive  design  constraints  for  the  inner-loop 
tracking  performance  that  guarantee  stability  of  the  complete  cooperative  control  architecture. 

It  is  also  important  to  note  that,  in  this  setup,  it  is  the  autopilot  that  determines  the  bank  angle  required 
to  track  the  angular-rate  commands  qc{t)  and  rc(t).  Therefore,  it  is  justified  to  assume  that  the  UAV  roll 
dynamics  (roll  rate  and  bank  angle)  are  bounded  for  bounded  angular-rate  commands  corresponding  to  the 
set  of  feasible  paths  considered. 

For  the  missions  of  interest,  typical  off-the-shelf  autopilots  are  capable  of  providing  uniform  performance 
across  the  flight  envelope  of  small  UAVs  while  operating  in  nominal  conditions.  However,  these  commercial 
autopilots  may  fail  to  provide  adequate  performance  across  the  operational  envelope  in  the  event  of  actuator 
failures,  vehicle  damage,  or  in  the  presence  of  adverse  environmental  disturbances.  Under  these  unfavorable 
circumstances,  adaptive  augmentation  loops  are  seen  as  an  appealing  technology  that  can  improve  vehicle 
performance.  In  [24,42],  for  example,  we  present  an  C\  adaptive  control  architecture  for  autopilot  augmen¬ 
tation  that  retains  the  properties  of  the  onboard  commercial  autopilot,  and  adjusts  the  autopilot  commands 
only  when  the  tracking  performance  degrades.  Figure  2  shows  the  inner-loop  control  architecture  considered 
in  [24,42],  with  the  adaptive  augmentation  loop  wrapped  around  the  autopilot.  The  adaptive  controller 


(11a) 
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Figure  2.  Inner-loop  control  structure  with  the  C\  adaptive  augmentation  loop  [24,42]. 


uses  angular-rate  and  speed  measurements  to  modify  the  commands  generated  by  the  outer-loop  algorithms, 
which  are  then  sent  to  the  autopilot  as  references  to  be  tracked.  This  structure  for  autopilot  augmentation 
does  not  require  any  modifications  to  the  autopilot  itself,  and  at  the  same  time  it  does  not  use  internal  states 
of  the  autopilot  for  control  design  purposes. 

III.  3-D  Path  Following  for  a  Single  UAV 

This  section  describes  an  outer-loop  3-D  path-following  nonlinear  control  algorithm  that  uses  vehicle  angu¬ 
lar  rates  to  steer  the  ith  vehicle  along  the  spatial  path  Pd,i{-)  for  an  arbitrary  feasible  speed  profile  (temporal 
assignment  along  the  path).  Controller  design  builds  on  previous  work  by  the  authors  on  path- following 
control  of  small  tactical  UAVs,  reported  in  [24],  and  derives  new  path- following  control  laws  on  SO (3)  that 
avoid  the  geometric  singularities  and  complexities  that  appear  when  dealing  with  local  parameterizations  of 
the  vehicle’s  attitude.  First,  we  address  only  the  kinematic  equations  of  the  UAV  by  taking  pitch  rate  and 
yaw  rate  as  virtual  outer-loop  control  inputs.  In  particular,  we  show  that  there  exist  stabilizing  functions  for 
q(t)  and  r[t)  leading  to  local  exponential  stability  of  the  origin  of  Qe  with  a  prescribed  domain  of  attraction. 
Then,  we  perform  a  stability  analysis  for  the  case  of  non-perfect  inner-loop  tracking  and  show  that  the 
path-following  errors  are  locally  uniformly  ultimately  bounded  with  the  same  domain  of  attraction.  The 
results  yield  an  efficient  methodology  to  design  path-following  controllers  for  UAVs  with  due  account  for  the 
vehicle  kinematics  and  the  characteristics  of  their  inner-loop  autopilots. 

III. A.  Nonlinear  Control  Design  using  UAV  Kinematics 

Recall  from  Section  II. A  that  the  main  objective  of  the  path-following  control  algorithm  is  to  drive  the 
position  error  pF{t)  and  the  attitude  error  ep{t)  to  zero.  At  the  kinematic  level,  these  objectives  can  be 
achieved  by  determining  feedback  control  laws  for  q(t),  r(t),  and  £(t)  that  ensure  that  the  origin  of  the 
kinematic-error  equations  in  (6)  is  exponentially  stable  with  a  given  domain  of  attraction.  Figure  3  presents 
the  kinematic  closed-loop  system  considered  in  this  section. 

To  solve  the  path-following  problem,  we  first  let  the  rate  of  progression  of  point  P  along  the  path  be 
governed  by 

l  =  (vwi  +  KipF)  ■  t,  (14) 

where  Kg  is  a  positive  constant  gain.  Then,  the  rate  commands  qc(t)  and  rc(t)  given  by 

Qc 

rc 

where  K ^  is  also  a  positive  constant  gain,  drive  the  path- following  generalized  error  vector  xpf(t )  to  zero 
with  a  guaranteed  rate  of  convergence.  A  formal  statement  of  this  result  is  given  in  the  lemma  below. 
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Figure  3. 


Path-following  closed-loop  system  for  a  single  UAV  solved  at  a  kinematic  level. 


Lemma  1  Assume  that  the  UAV  speed  v(t)  verifies  the  following  bounds: 


0  ^  Unin  — 


Vt  >  0. 


(16) 


If  for  given  positive  constants  c  <  and  c\,  we  choose  the  path-following  control  parameters  K(,  Kk, 
and  d  such  that 

(17) 


K-  K  >  _ max _ 

R  p>  cf(l  —  2c2)2 


where  Kp  is  defined  as 


Kp  =  min  <  Ke, 


(18) 


(cP  +  c^j 

then  the  rate  commands  in  (15),  together  with  the  law  in  (14)  for  the  rate  of  progression  of  the  virtual  target 
along  the  path,  ensure  that  the  origin  of  the  kinematic- error  equations  in  (6)  is  exponentially  stable  with 
guaranteed  rate  of  convergence 


\*  a 
\f  ~ 


Kp  +  Kk{  1  -  c2)  1 


-o  [(Kp-Knil-c2))  + 


2  4(1  —  c2) 


c2(l-2c2)2 


and  domain  of  attraction 


nc  4  <j  (Pf,R)  e  K3  X  SO(3)  I  *(R)  +  ^\\pf\\2  <<?<\ 


(19) 


(20) 


Proof:  The  proof  of  this  result,  which  uses  some  insight  from  [43],  is  given  in  Appendix  B. 


Remark  1  The  choice  of  the  characterizing  distance  d  in  the  definition  of  the  auxiliary  frame  T>  (see  ( 2 )) 
can  be  used  to  adjust  the  rate  of  convergence  for  the  path-following  closed-loop  system.  This  is  consistent 
with  the  fact  that  a  large  parameter  d  reduces  the  penalty  for  cross-track  position  errors,  which  results  in  a 
slow  rate  of  convergence  of  the  UAV  to  the  path.  Insights  into  this  path-following  control  algorithm  can  be 
found  in  [44]- 


III.B.  Stability  Analysis  for  Non-Perfect  Inner-Loop  Tracking 

The  stabilizing  control  laws  in  (14)  and  (15)  lead  to  local  exponential  stability  of  the  origin  of  the  path¬ 
following  kinematic-error  dynamics  (6)  with  a  prescribed  domain  of  attraction.  In  general,  this  result  does 
not  hold  when  the  dynamics  of  the  UAV  are  included  in  the  problem  formulation.  In  this  section,  we  perform 
a  stability  analysis  of  the  path-following  closed-loop  system  for  the  case  of  non-ideal  inner-loop  tracking.  In 
particular,  we  assume  that  the  onboard  autopilot  ensures  that  the  UAV  is  able  to  track  bounded  pitch-rate 
and  yaw-rate  commands  with  the  performance  bounds  in  (11)  and  show  that  the  path-following  errors  PFit ) 
and  ek(t)  are  locally  uniformly  ultimately  bounded  with  the  same  domain  of  attraction  f lc.  The  next  lemma 
states  this  result  formally. 
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Lemma  2  Assume  that  the  UAV  speed  v(t)  verifies  the  bounds  in  (16).  For  given  positive  constants  c  < 
and  ci,  choose  the  path-following  control  parameters  K i,  K^,  and  d  according  to  the  design  constraint  in  (17). 
Further,  let  6pf  be  a  positive  constant  verifying 


o<sx<x;f,  (21) 

where  A*y  was  defined  in  (19).  If  the  performance  bounds  and  7r  in  (11)  satisfy  the  following  inequality: 


lu  =  (7 q  +  7r)  2  < 


2  c 


(l-c2)i 


-<5a, 


(22) 


then,  for  any  initial  state  (pf(0),  R(0))  £  Qc,  the  rate  commands  in  (15),  together  with  the  law  in  (14)  for 
the  rate  of  progression  of  the  virtual  target  along  the  path,  ensure  that  there  is  a  time  Tb  >  0  such  that  the 
path-following  errors  PF{t)  andepff)  satisfy 


IM4I2  +  4lM*)ll2  <  ( 7^11^(0)11  +  4t|M0)||)  , 

C1  \ 1  c  C1  / 


2/  (1-c2)72 


V  0  <  t  <  Tb ,  (23) 

V  t>Tb.  (24) 


Proof:  The  proof  of  this  result  is  given  in  Appendix  C. 


Remark  2  Inequalities  (23)  and  (24)  show  that  the  path-following  errors  PF(t)  and  e^(t)  are  uniformly 
bounded  for  all  t  >  0  and  uniformly  ultimately  bounded  with  ultimate  bounds 

(1  —  c2 )  2 

l|e«W11-  2 sT~7u”  vt~Tb ’ 

\\PF(t)\\  <  Cl{1~§f)2  Vt>Tb. 

These  ultimate  bounds  are  proportional  to  the  inner-loop  tracking  performance  bound  7U  and,  in  the  limit 
ideal  case  of  perfect  inner-loop  tracking,  one  recovers  the  exponential  stability  result  derived  in  Lemma  1. 


IV.  Time-Critical  Coordination 


The  previous  section  offered  a  solution  to  the  path-following  problem  for  a  single  vehicle  and  an  arbitrary 
feasible  speed  profile  by  using  a  control  strategy  in  which  the  vehicle’s  attitude  control  effectors  are  used 
to  follow  a  virtual  target  running  along  the  path.  We  now  address  the  problem  of  time-critical  cooperative 
control  of  multiple  vehicles.  To  this  effect,  the  speeds  of  the  vehicles  are  adjusted  based  on  coordination 
information  exchanged  among  the  vehicles  over  a  time-varying  network.  In  particular,  the  outer-loop  coor¬ 
dination  control  law  is  intended  to  provide  a  correction  to  the  desired  speed  profile  Vd,i(-)  obtained  in  the 
trajectory-generation  step,  and  to  generate  a  total  speed  command  vCti(t).  This  speed  command  is  then  to 
be  tracked  by  the  ith  vehicle  to  achieve  coordination  in  time. 

We  start  by  recalling  from  Section  II. B  that  the  main  objective  of  the  time-critical  cooperative  algorithm 
is  to  drive  the  coordination  errors  |£i(f)  —  to  a  neighborhood  of  the  origin.  To  solve  this  coordination 

problem,  we  first  note  that  the  evolution  of  the  *th  coordination  state  is  given  by 


dy  i 
d£' 


m 


From  the  definitions  of  £'d  ,(•)  and  we  have  that  the  following  equality  holds  for  all  t\  £  [0, 1]: 


4  i  M4)  =  % 


from  which  one  can  show  that 


d  r]i 
d£' 


1 

jfVd,i{ru{£'i))  1 


V  4  e  [0,  l] . 
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Then,  the  time  derivative  of  the  ith  coordination  state  can  be  expressed  as 


hit) 

vd,i  (£i  (t)) 


Next,  we  recall  from  the  solution  to  the  path- following  problem  that  the  evolution  of  the  *th  virtual  target 
vehicle  along  the  path  is  given  by 

ii  =  ( Vi  Witi  +  Kt  pF>i)  ■  U  , 

where  for  simplicity  we  keep  Kf  without  indexing  and  we  drop  the  dependency  of  the  various  variables  on  t. 
The  dynamics  of  the  ith  coordination  state  can  thus  be  rewritten  as 


6 


( Vi  wi ,j  +  KePF,i)  ■  U 


At  this  point,  it  is  important  to  remark  that,  if  the  path-following  control  law  can  guarantee  that,  for 
every  UAV,  the  quantity  (wi,i  •  ti)  is  positive  and  bounded  away  form  zero  for  all  t  >  0,  that  is, 


witi  -ti>C2>  0  ,  V  t  >  0  ,  V  i  G  {1, . . . ,  n}  , 


(25) 


where  0  <  C2  <  1,  then,  to  solve  the  coordination  problem,  we  can  use  dynamic  inversion  and  define  the 
speed  command  for  the  ith  vehicle  as 


VCti 


A 


Hcoord,z  Vd,i  (£z)  Ab  P [\t  *  tj 
Wl,i  '  U 


(26) 


where  uCOOTd,i(t)  is  a  coordination  control  law,  yet  to  be  defined.  With  this  speed  command,  the  partially 
closed-loop  coordination  dynamics  for  the  ith  target  vehicle  can  be  rewritten  as 


ii 


^coord,i 


^l,z  ’  ti  j 


(27) 


where  eVji{t)  =  Vi(t)  —  vc^{t)  denotes  the  velocity  tracking  error  for  the  *th  vehicle.  In  what  follows,  we 
assume  that  the  bound  in  (25)  holds  for  every  vehicle  and  derive  a  coordination  control  law  ucoord,i{t)  that 
achieves  coordination  for  the  entire  fleet  of  UAVs.  This  assumption  will  be  verified  later  in  Section  V,  where 
we  derive  an  expression  for  the  constant  C2,  and  prove  stability  of  the  combined  time-critical  cooperative 
path-following  closed-loop  system. 

Recall  now  that  each  vehicle  is  allowed  to  exchange  only  its  coordination  parameter  (t)  with  its  neigh¬ 
bors  Gj,  which  are  defined  by  the  possibly  time- varying  communications  topology.  To  observe  this  constraint, 
we  propose  the  decentralized  coordination  law 


Wcoord,l  (t)  —  a  'y  '  (Cl  {t)  £,j{t))  T  1  J 

j'eGi 

Hcoord ,i(t)  =  0  ^  )  (Ci(^)  C.7  (t) )  T  Xl ,i(t )  ; 

j£Gi 

XI At)  =  -  Ci(i)) ,  Xi,i (o)  =  1 , 

jeGi 


(28a) 

i  =  2,-. 

-,n, 

(28b) 

i  =  2,-. 

-,n, 

(28c) 

where  vehicle  1  is  elected  as  the  formation  leader  (which  can  be  a  virtual  vehicle ),  and  a  and  b  are  positive 
adjustable  coordination  control  gains.  Note  that  the  coordination  control  law  has  a  proportional-integral 
structure,  which  provides  disturbance  rejection  capabilities  at  the  coordination  level.  Moreover,  we  note  that 
the  vehicles  exchange  information  only  about  the  corresponding  virtual  targets,  rather  than  exchanging  their 
own  state  information.  The  importance  of  this  observation  can  hardly  be  overemphasized.  The  benefits  of 
using  “virtual  information”  in  consensus  problems  are  illustrated  in  [45]. 

The  coordination  law  in  (28)  can  be  rewritten  in  compact  form  as 

Mcoord  (t)  =  — aL(t)  £(t )  +  [XJ(t)]  )  ,  . 

xAt)  =  ~bcTmm,  xi,i  (o)  =  i , 
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where  f{t)  =  [t,l(t),  .  .  .  ,£n(t)]T ,  Ucoold(t)  =  [ucoord)l(t),  ■  •  •  >  «coord,n(i)]T>  Xi(t)  =  [x/,2(i),---,X/,n(i)]T, 
CT  =  [  0  I„_i  ],  and  L(t)  is  the  Laplacian  of  the  undirected  graph  T(t)  that  captures  the  underlying 
bidirectional  communications  network  topology  of  the  UAV  formation  at  time  t.  It  is  well  known  that 
the  Laplacian  of  an  undirected  graph  is  symmetric,  LT (t)  =  L(t),  and  positive  semi-definite,  L(t)  >  0; 
Ai (L(t))  =  0  is  an  eigenvalue  with  eigenvector  ln,  L(t)ln  =  0;  and  the  second  smallest  eigenvalue  of  L{t)  is 
positive  if  and  only  if  the  graph  T(f)  is  connected,  that  is, 


xT L(t)x  , 

SS  “W  =  2<  ( ”  > 

i)(x=o 


r(t)  connected . 


Next,  we  reformulate  the  coordination  problem  stated  above  into  a  stabilization  problem.  To  this  end, 
we  define  the  projection  matrix  II  as 


n 

and  we  note  that  II  =  IIT  =  II2  and  also  that  QTQ  =  II,  where  Q  is  the  (n  —  1)  x  n  matrix  introduced 
in  (10).  Moreover,  we  have  that  L[t)  II  =  IIL(t)  =  L(t),  and  the  spectrum  of  the  matrix  L(t)  =  Q  L(t)  QT 
is  equal  to  the  spectrum  of  L(t)  without  the  eigenvalue  Ai  =  0  corresponding  to  the  eigenvector  1„.  Finally, 
we  define  the  coordination  error  state  f(t)  =  [Ci(^)T,  C2 (^)T] T  as 

cic t)  =  Qm 

C2  (t)  =  XI if)  -  ln-1  • 


By  definition,  (,\(t)  =  0  is  equivalent  to  £(t)  £  span{ln},  which  implies  that,  if  £(i)  =  0,  then  all  target 
vehicles  are  coordinated  at  time  t. 

With  the  above  notation,  the  closed-loop  coordination  dynamics  formed  by  (27)  and  the  coordination 
control  algorithm  defined  in  (29)  can  be  reformulated  as 

at)  =  F(t)((t)  +  He'v(t),  (30) 


Where  F(t)  £  R(2"-2)x(2n-2)  and  H  g  l(2n-2)xn  &re  giyen  by 


m  = 


—aL(t)  QC 
-bCTQTL{t)  0 


and  e'v{t)  £  Rra  is  a  vector  with  its  ith  component  being  equal  to  e'v  i  =  )  tyi,»  •  U. 

Next  we  show  that,  if  the  connectivity  of  the  communications  graph  T(t)  verifies  the  PE-like  condition  (10) 
and,  in  addition,  every  vehicle  travels  at  the  commanded  speed  vc^{t)  (that  is,  evd{t)  =  0),  then  the 
coordinated  system  asymptotically  reaches  agreement  and  all  the  vehicles  travel  at  the  desired  speed 


lim  (£i(t)  -  £j{t))  =0,  V  i,j  £  {1, . . .  ,n} 

t—¥  OO 

lim  £(t)  =  ln  . 

t—*  OO 

On  the  other  hand,  if  ev>i(t )  ^  0  for  some  t  >  0,  then  the  coordination  error  vector  degrades  gracefully  with 
the  size  of  speed  tracking  error  ev(t)  =  [ev,i(t), . . . ,  e„)Tl(f)]T.  The  next  lemma  summarizes  this  result. 


Lemma  3  Consider  the  coordination  system  (30)  and  suppose  that  the  Laplacian  of  the  graph  that  models 
the  communications  topology  satisfies  the  PE-like  condition  (10)  for  some  parameters  p,  and  T.  Moreover, 
assume  that  the  speed  tracking  error  vector  ev(t)  is  bounded  for  all  t  >  0.  Then,  there  exist  coordination 
control  gains  a  and  b  such  that  the  system  (30)  is  input-to- state  stable  (ISS)  with  respect  to  ev(t),  satisfying 

IICWII  <  fci||C(0)||e_Ac‘  +  k2  sup  |Mt)||,  Vf>0,  (31) 

re[0,t) 

for  some  (computable)  positive  constants  k\  and  k,2,  and  with 

x  >  T  A  anT _ 1 

c-  c  (1  +  anT)2  2n^E+l  ' 
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Furthermore,  the  coordination  states  £,i(t)  and  their  rates  of  variation  £,i(t)  satisfy 

lim  sup  |&(t)  -  £j(t) |  <  k3  lim  sup  ||e„(f)||,  (32) 

t—>  oo  t—>oo 

lim  sup  \£i{t)  —  11  <  ki  lim  sup  ||e„(f)||  ,  (33) 

t— VOO  t—>  OO 

for  all  i,j  £  {1, . . .  ,n\,  and  for  some  (computable)  positive  constants  k3  and  k 4. 

Proof:  The  proof  of  this  result  is  given  in  Appendix  D. 

Remark  3  Lemma  3  above  indicates  that  the  QoS  of  the  network  ( characterized  by  the  parameters  T  and 
y)  limits  the  achievable  (guaranteed)  rate  of  convergence  for  the  coordination  control  loop.  According  to  the 
lemma,  for  a  given  QoS  of  the  network,  the  maximum  (guaranteed)  rate  of  convergence  A*  is  achieved  by 
setting  a*  =  which  results  in 

—  1 

c  4T  2ny/n  +  1 

Also,  it  is  important  to  mention  that,  as  the  parameter  T  goes  to  zero  (graph  connected  pointwise  in  time), 
the  convergence  rate  can  be  set  arbitrarily  fast  by  increasing  the  coordination  control  gains  a  and  b.  This  is 
consistent  with  results  obtained  in  previous  work  by  the  authors  (see  [46,  Lemma  2]). 

Finally,  we  notice  that 

A  any. 

7A  =  (1  +anT)2 

represents  the  (guaranteed)  convergence  rate  for  the  coordination  loop  with  a  proportional  control  law,  rather 
than  a  proportional-integral  control  law  (see  Appendix  D).  It  is  straightforward  to  verify  that,  for  a  given 
proportional  gain  a,  we  have  that  Xc  <77,  which  implies  that  a  proportional  control  law  can  provide  higher 
rates  of  convergence  than  the  proportional-integral  control  law  used  in  this  paper.  However,  as  mentioned 
earlier,  the  integral  term  in  the  coordination  control  law  is  important  in  the  current  application  as  it  provides 
disturbance  rejection  capabilities  at  the  coordination  level. 

V.  Combined  Path  Following  and  Time-Critical  Cooperation 

In  the  previous  sections  we  have  shown  that,  under  an  appropriate  set  of  assumptions,  the  path- following 
and  coordination  control  laws  are  able  to  ensure  stability  and  ultimate  boundedness  of  the  path-following 
and  time-critical  cooperation  problems  when  treated  separately.  In  particular,  the  solution  developed  for  the 
path-following  problem  assumes  that  the  speed  of  the  UAV  is  bounded  above  and  below,  while  the  control 
law  designed  for  vehicle  coordination  relies  on  the  assumption  that  the  angle  between  the  UAV’s  velocity 
vector  and  the  tangent  direction  to  the  path  is  less  than  90  deg  (see  assumptions  (16)  and  (25)).  This  section 
addresses  the  convergence  properties  of  the  combined  cooperation  and  path-following  systems,  and  derives 
design  constraints  for  the  inner-loop  tracking  performance  bounds  that  guarantee  stability  of  the  complete 
system.  The  cooperative  path-following  control  architecture  for  the  ith  UAV  is  presented  in  Figure  4. 

In  this  section,  we  assume  that  the  onboard  autopilot  ensures  that  each  UAV  is  able  to  track  bounded 
pitch-rate,  yaw-rate,  as  well  as  speed  commands  with  the  performance  bounds  in  (11)-(13).  At  this  point, 
we  note  that,  while  the  pitch-rate  and  yaw-rate  commands  in  (15)  are  continuous  in  time,  the  same  cannot 
be  said  about  the  speed  command  in  (26).  In  fact,  due  to  the  time- varying  nature  of  the  network  topology, 
the  coordination  law  uCOOTd(t )  in  (28)  is  discontinuous,  which  implies  that  the  speed  command  vc(t)  is  also 
discontinuous.  Assuming  that  the  following  bound  holds  for  all  vehicles  and  for  alH  >  0, 

\vc,i(t)  ~  Vi(t)\  <  ,  i  =  l,...,n,  (34) 


which  implies  that 

sup  || e„ (Oil  <  Vnjv  , 

t>  0 

then  the  maximum  amplitude  A vCii  of  a  jump  in  the  speed  command  vc^(t)  can  be  derived  from  (26),  (28) 
and  the  results  of  Lemma  3,  and  is  given  by 

A  2a(n  -  l)wd,imax  (fci||C(0)||  +  k2y/njv)  . 

A  vc<i  = - ,  t  =  l  ,...,n, 

C2 
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Figure  4. 


Time-critical  cooperative  path-following  closed-loop  for  the  ith  vehicle  with  C\  augmentation. 


where  Vd,i  max  was  introduced  in  (8).  Thus,  a  necessary  (but  by  no  means  sufficient)  condition  for  the  bound 
in  (34)  to  hold  is  that 

AuCii  <  ,  i  =  l,...,n. 

The  above  condition  limits  the  choice  of  the  coordination  control  gains,  which  in  particular  need  to  satisfy 
the  following  inequality 

2 a(n-  l)vd,imaxk2\/n  <  c2,  i  =  l,...,n. 

However,  the  derivation  of  sufficient  conditions  that  guarantee  that  the  bound  in  (13)  holds  for  all  time 
requires  assumptions  on  vehicle  dynamics  and  autopilot  design,  and  is  thus  beyond  the  scope  of  this  paper. 
Hence,  for  the  subsequent  developments,  we  make  the  assumption  that  the  bound  in  (13)  holds  -provided  the 
speed  command  vc,i(t)  satisfies  the  bounds  in  (12)-,  and  derive  design  constraints  for  this  inner-loop  tracking 
performance  bound  that  ensure  that  the  overall  time-critical  cooperative  path-following  control  system  is 
stable  and  has  desired  convergence  properties.  The  next  theorem  summarizes  this  result. 


Theorem  1  Consider  a  fleet  of  n  UAVs  supported  by  a  communications  network  that  satisfies  the  PE-like 
condition  in  (10).  Let  c  and  c\  be  positive  constants,  with  c  <  -^=.  For  each  UAV,  choose  the  path-following 
control  parameters  K(,  K fi,  and  d  such  that 


2c(l  —  c2)  = 
d  >  1  —  2c2  Cl 


K  -  K  >  _ max _ 

R  p  c?(l-2 c2)2  ’ 


(35) 

(36) 


where  Kp  is  defined  as  in  (18).  Also,  choose  the  coordination  control  gains  a  and  b  such  that 


a  >  0 , 


b  = 


2  n 


a2np 


(37) 


2 n\fn  +  1  (1  +  anT)2  ’ 

and  let  k\  and  be  the  constants  in  (31)  for  this  particular  choice  of  control  gains  a  and  b.  Further,  let  the 
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performance  bounds  7?,  jr,  and  7 v  satisfy  the  following  inequalities: 


7„  <  min 


(7g  +  7r)5  < 


2c 


—  , 


^maxC2  max 


C2  +  fofrf  max 


(l-c2)^ 

-fQcCi  Udmin  ^min  A^CCl  1 


1  +  k2vd  max  \/n  J 


(38) 

(39) 


where  8\  is  a  constant  satisfying  (21),  Udmax  —  max,=ir..in^i!max,  vdmin  —  min*-i,...,n  Ud.imin,  while  c2 
and  k2  are  defined  as: 


A  d(l  —  2c2)  —  2cic2(l  —  c2)  2 
=  {d?  +c2c\)^ 


k2  =  (2 a(n  —  1)  +  l)k2  • 


Then,  the  progression  law  in  (14),  the  rate  commands  in  (15),  and  the  speed  commands  in  (26)  with  the 
coordination  control  law  in  (28)  ensure  that,  for  all  initial  conditions 


(j>F,i{0),  Ri{0))  £  , 


r 


S'!  \ 


^max  '7't 

max 


C2  -  1  , 


Vdi 


Vdi 


i  =  1, . . . ,  n 

Vmin  +  7 
Vd  max 


-  k2^fn^v  - 


Kecci  \ 
Vd  max  J 


(40) 

(41) 


where  k\  =  (2a(n  —  1)  +  l)fci,  there  exist  times  Tbti  >  0  and  a  positive  constant  Xc  <  Ac  such  that  the 
path-following  errors  pF.iit)  and  e^j(t)  for  the  ith  UAV  satisfy 


\\en,M\2  +  \\\PF,i{t)\\2  <  ( z  ~~2  II^h,«(0) II  +  4lb^(0)ll) 

C1  \  1  C  C1  J 

lleA,»ft)ll2  +  4lbf,i(*)ll2  <  (1  . 

C1  aoA 

while  the  coordination  error  states  f(t)  satisfy 

IICWII  <  fci||C(0)||e_Act  +  k2y/n/yv  , 


e_2(Ap/_5A^ , 


Vi  >  0. 


V0<t<TtiI,  (42) 

V  t  >  Tbti ,  (43) 

(44) 


Proof:  The  proof  of  this  result  is  given  in  Appendix  E. 


Remark  4  Inequalities  (42)  and  (43)  show  that  the  path-following  errors  PF,i{t)  and  e^j(f)  are  uniformly 
bounded  for  all  t  >  0  and  uniformly  ultimately  bounded  with  ultimate  bounds 

llefl,ib)ll  <  ^  2sJ  Vt>Tfe,  V  i£{l,...,n}, 

lbf,»ft)ll  <  Cl^0c  C  ^  7u>,  V  t  >  Tf, ,  Vie  {l,...,n}, 

2oa 

which  are  proportional  to  the  inner-loop  tracking  performance  bound  7^.  On  the  other  hand,  inequality  (44) 
implies  that  the  coordination  error  state  f(t)  converges  exponentially  fast  to  a  neighborhood  of  the  origin  with 
radius  proportional  to  the  inner-loop  speed  tracking  performance  bound  7„.  This  implies  that,  in  the  limit 
case  of  perfect  inner-loop  tracking,  the  path-following  errors  of  each  vehicle  and  the  coordination  error  state 
vector  converge  exponentially  fast  to  zero. 


VI.  Cooperative  Road  Search  with  Multiple  Unmanned  Aerial  Vehicles 

I11  this  section  we  discuss  flight  test  results  for  a  cooperative  road-search  mission  that  show  the  efficacy  of 
the  multi-vehicle  cooperative  control  framework  presented  in  this  paper.  Cooperative  path-following  missions 
involving  multiple  UAVs  were  flown  for  the  first  time  at  Camp  Roberts,  CA,  in  November  2009,  and  then 
demonstrated  four  more  times  at  the  same  location  in  February,  May,  July,  and  November  of  2010.  More 
flight  tests  are  expected  in  November  2011.  The  results  in  this  section  verify  the  main  theoretical  claims 
of  the  cooperative  control  algorithm  presented  in  this  paper  and  demonstrate  the  feasibility  of  the  onboard 
implementation  of  the  algorithms  and  the  validity  of  the  approach. 
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Figure  5.  Coordinated  road  search  using  multiple  UAVs. 


VI. A.  Mission  description 

One  of  the  applications  that  motivates  the  use  of  multiple  cooperative  UAVs  and  poses  several  challenges  to 
systems  engineers,  both  from  a  theoretical  and  practical  standpoint,  is  automatic  road  search  for  improvised 
explosive  device  detection;  see  Figure  5.  The  mission  is  initiated  by  a  minimally  trained  user  who  scribbles 
a  path  on  a  digital  map,  generating  a  precise  continuous  ground-track  for  the  airborne  sensors  to  follow. 
This  ground-track  is  then  transmitted  over  the  network  to  a  fleet  of  small  tactical  UAVs  equipped  with 
complementary  visual  sensors.  Decentralized  optimization  algorithms  autonomously  generate  feasible  flight 
trajectories  that  maximize  road  coverage  and  account  for  sensor  capabilities  held  of  view,  resolution,  and 
gimbal  constraints-  as  well  as  inter-vehicle  and  ground-to-air  communications  limitations.  The  fleet  of 
UAVs  then  starts  the  cooperative  road  search.  During  this  phase,  the  information  obtained  from  the  sensors 
mounted  onboard  the  UAVs  is  shared  over  the  network  and  retrieved  by  remote  users  in  near  real  time.  The 
explosive  device  detection  can  thus  be  done  remotely  on  the  ground,  based  on  in-situ  imagery  data  delivered 
over  the  network. 

In  this  particular  mission  scenario,  a  robust  cooperative  control  algorithm  for  the  fleet  of  UAVs  can  im¬ 
prove  mission  performance  and  provide  reliable  target  discrimination,  by  effectively  combining  the  capabilities 
of  the  onboard  sensors.  In  fact,  hying  in  a  coordinated  fashion  is  what  allows,  for  example,  to  maximize  the 
overlap  of  the  helds  of  view  (FOVs)  of  multiple  sensors  and  to  take  full  advantage  of  complementary  sensors. 

VI. B.  Airborne  system  architecture 

The  small  tactical  UAVs  employed  in  this  particular  mission  are  two  SIG  Rascals  110  operated  by  NPS; 
see  Figure  6.  The  two  UAVs  have  the  same  avionics  and  the  same  instrumentation  onboard,  the  only 
difference  being  the  vision  sensors.  The  hrst  UAV  has  a  bank-compensated  high-resolution  12-MPx  imagery 
camera,  while  the  second  UAV  has  a  full-motion  video  camera  suspended  on  a  pan-tilt  gimbal.  Due  to 
payload  constraints,  each  UAV  is  allowed  to  carry  only  one  camera  at  a  time,  and  therefore  the  two  cameras 
need  to  be  mounted  on  different  platforms.  The  rest  of  the  onboard  avionics,  common  to  both  platforms, 
includes  two  PC-104  industrial  embedded  computers  [47]  assembled  in  a  stack,  a  wireless  Mobile  Ad-hoc 
Network  (MANET)  link  [  18],  and  the  Piccolo  Plus  autopilot  [49]  with  its  dedicated  900-MHz  command  and 
control  channel.  Details  of  the  complete  airborne  network-centric  architecture  are  presented  in  Figure  7. 

The  first  PC-104  computer  acts  as  a  secondary  autopilot  controller,  running  the  cooperative-control 
algorithms  in  hard  real  time  at  100  Hz  and  directly  communicating  with  the  Piccolo  Plus  autopilot  at 
50  Hz  over  a  dedicated  serial  link.  This  connection  efficiently  eliminates  communication  delays  between  the 
outer-loop  control  algorithms  and  the  autopilot.  The  second  PC-104  is  a  mission  management  computer 
that  implements  a  set  of  non-real-time  routines  enabling  onboard  preprocessing  and  retrieval  of  the  sensory 
data  -high-resolution  imagery  or  video-  in  near  real  time  over  the  network.  Integration  of  the  MANET 
link  allows  for  robust  transparent  inter-vehicle  and  ground  communication,  which  is  needed  for  both  the 
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(a)  SIG  Rascal  110  research  aircraft. 


(b)  High-resolution  camera.  (c)  Full-motion  video  camera. 

Figure  6.  SIG  Rascal  UAV  with  two  different  onboard  cameras. 


coordination  algorithms  and  the  expedited  sensory  data  delivery  to  a  remote  mission  operator.  In  fact,  the 
MANET  link  provides  “any-to-any”  connectivity  capability,  allowing  every  node  -vehicle  or  ground  station- 
to  communicate  directly  with  every  other  node.  Moreover,  information  about  the  connectivity  of  the  entire 
network  can  be  retrieved  in  near  real  time.  Details  on  the  flight  test  architecture  and  the  supporting  network 
infrastructure  for  coordination  control  and  data  dissemination  can  be  found  in  [48,50]. 

VI.  C.  Flight  Test  Results 

We  now  present  flight  test  results  for  a  cooperative  road-search  mission  executed  by  the  two  SIG  Rascals. 
The  objective  of  the  mission  is  to  detect  a  target  moving  along  a  given  road  and,  if  detection  occurs,  to 
collect  information  about  the  target.  This  information  is  then  to  be  shared  over  a  MANET  link  so  that  it 
can  be  retrieved  by  remote  mission  operators  in  near  real  time.  Success  of  the  mission  relies  on  the  ability 
to  overlap  the  footprint  of  the  FOVs  of  the  two  cameras  along  the  road,  which  increases  the  probability  of 
target  detection  [51].  Next,  we  provide  details  about  the  execution  of  this  coordinated  road-search  mission, 
which  we  divide  in  four  consecutive  phases,  namely,  initialization,  transition,  road  search,  and  vision-based 
target  tracking.  The  description  is  supported  by  one  of  the  flight  tests  results  performed  during  a  Tactical 
Network  Testbed  field  experiment  at  Camp  Roberts,  CA;  see  figures  8-11. 

In  the  initialization  phase ,  an  operator  specifies  on  a  digital  map  the  road  of  interest.  Then,  a  centralized 
optimization  algorithm  generates  road-search  suboptimal  paths  and  desired  speed  profiles  for  the  two  UAVs 
that  explicitly  account  for  UAV  dynamic  constraints,  collision-avoidance  constraints,  and  mission-specific 
constraints  such  as  inter-vehicle  and  vehicle-to-ground  communications  limitations  as  well  as  sensory  ca¬ 
pabilities.  In  particular,  the  trajectory-generation  algorithm  is  designed  to  maximize  the  overlap  of  the 
footprints  of  the  FOVs  of  the  high- resolution  camera  and  the  full-motion  video  during  the  road  search.  In 
addition  to  the  road-search  paths  and  the  corresponding  desired  speed  profiles,  the  outcome  of  the  trajectory- 
generation  algorithm  includes  a  sensor  trajectory  on  the  ground  to  be  followed  by  the  vision  sensors.  The 
two  road-search  paths  and  the  sensor  path,  along  with  the  three  corresponding  speed  profiles,  are  then 
transmitted  to  the  UAVs  over  the  MANET  link. 

In  the  transition  phase,  the  two  UAVs  fly  from  their  standby  starting  positions  to  the  initial  points  of 
the  respective  road-search  paths.  For  this  purpose,  decentralized  optimization  algorithms  generate  feasible 
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Figure  7.  Network-Centric  architecture  of  the  airborne  platform. 


collision-free  3D  trajectories  to  ensure  that  the  two  UAVs  arrive  at  the  initial  points  of  the  road-search 
paths  at  the  same  time.  Once  these  transition  trajectories  are  generated,  the  two  vehicles  start  operating 
in  cooperative  path-following  mode.  From  that  moment  on,  the  UAVs  follow  the  transition  paths  while 
adjusting  their  speeds  based  on  coordination  information  exchanged  over  the  MANET  link  in  order  to 
achieve  simultaneous  arrival  at  the  starting  point  of  the  road-search  paths.  The  transition  and  road-search 
spatially-deconflicted  paths  obtained  for  this  particular  mission  scenario,  together  with  the  corresponding 
desired  speed  profiles  and  the  path  separations,  are  shown  in  Figure  8.  Figure  9  illustrates  the  performance 
of  the  coordination  control  algorithm  during  the  transition  phase  of  the  mission. 

The  third  phase  addresses  the  cooperative  road-search  mission  itself,  in  which  the  two  UAVs  follow  the 
road-search  paths  generated  in  the  initialization  phase  while  adjusting  their  speeds  to  ensure  the  required 
overlap  of  the  FOV  footprints  of  the  cameras.  In  this  phase,  a  target  vehicle  running  along  the  sensor  path 
is  virtually  implemented  on  one  of  the  UAVs.  For  this  road-search  mission,  a  natural  choice  for  this  sensor 
path  is  the  road  itself,  and  this  virtual  vehicle  determines  thus  the  spot  of  the  road  being  observed  by  the 
vision  sensors  mounted  onboard  the  UAVs  at  a  given  time.  This  virtual  vehicle  is  indeed  used  as  a  leader 
in  the  coordination  algorithm,  and  its  speed  is  also  adjusted,  based  on  the  coordination  states  of  the  two 
UAVs.  The  coordination  state  of  this  virtual  vehicle  is  also  transmitted  over  the  tactical  network  and  used  in 
the  coordination  control  laws  of  the  two  “real”  vehicles.  The  performance  of  the  cooperative  path-following 
control  algorithm  is  illustrated  in  Figure  10.  For  this  particular  mission  scenario,  the  coordination  errors 
remain  below  7%  during  the  entire  duration  of  the  road  search,  while  the  path-following  cross-track  errors 
converge  to  a  3  m  tube  around  the  desired  spatial  paths. 

Finally,  when  a  target  is  detected  on  the  road,  the  two  UAVs  immediately  switch  to  cooperative  vision- 
based  tracking  mode.  In  this  phase,  the  UAVs  track  the  target  by  means  of  guidance  loops  that  use  visual 
information  for  feedback  [52],  while  simultaneously  providing  in-situ  imagery  for  precise  geo- location  of  the 
point  of  interest.  During  this  target-tracking  phase,  a  coordination  algorithm  ensures  that  the  two  UAVs 
keep  a  predefined  phase  separation  of  ^  rad  while  orbiting  around  the  target.  This  coordination  algorithm 
uses  the  decentralized  coordination  control  law  described  in  Section  IV  to  adjust  the  orbiting  speed  of 
the  UAVs,  with  the  main  difference  that  phase  on  orbit  is  now  used  as  a  coordination  state,  rather  than 
virtual  time.  Besides  collision  avoidance,  cooperation  through  phase- on- orbit  coordination  allows  for  several 
additional  benefits,  including  reduced  sensitivity  to  target  escape  maneuvers  [53]  and  possible  extraction  of 
3D  information  from  2D  images  [54].  The  performance  of  the  cooperative  path- following  control  algorithm 
is  illustrated  in  Figure  11,  which  shows  the  trajectories  of  the  two  UAVs  while  tracking  the  target  as  well  as 
the  phase-coordination  error  between  the  UAVs. 

In  summary,  the  results  presented  above  demonstrate  feasibility  and  efficiency  of  the  onboard  integration 
of  the  nonlinear  path- following  and  coordination  algorithms.  During  the  flight  experiments,  the  required 
control  commands  never  exceeded  the  limits  defined  for  the  UAV  in  traditional  waypoint  navigation  mode. 
At  the  same  time,  the  achieved  functionality  of  the  UAV  following  3D  curves  in  an  inertial  space  outperforms 
the  conventional  waypoint  navigation  method  typically  implemented  on  off-the-shelf  commercial  autopilots. 
These  results  provide  also  a  roadmap  for  further  development  and  onboard  implementation  of  advanced 
cooperative  algorithms,  opening  new  frontiers  for  UAV  operations. 
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North  (m) 


(d)  Path  separation  for  transition  phase. 


(e)  Path  separation  for  road-search  phase. 


Figure  8.  Coordinated  road-search  trajectory  generation. 
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||,  -  y  / 1*  (dimensionless)  /  ,*  (dimensionless) 


(a)  Normalized  coordination  states.  (b)  UAV  speeds. 


(c)  Normalized  coordination  error.  (d)  Inter-vehicle  separation. 

Figure  9.  Time-coordination  during  the  transition  phase. 
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(a)  Normalized  coordination  states. 


(b)  UAV  speeds. 


(c)  Normalized  coordination  error.  (d)  Inter-vehicle  separation. 

Figure  10.  Cooperative  path-following  control  during  the  road-search  phase. 
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(a)  3D  trajectories. 


(b)  2D  projections.  (c)  Phase-coordination  error. 

Figure  11.  Cooperative  vision-based  target  tracking  (CVBTT). 
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VII.  Conclusions 


This  paper  addressed  the  problem  of  multiple  Unmanned  Aerial  Vehicle  (UAV)  cooperative  control  in 
the  presence  of  time- varying  communications  networks  and  stringent  spatial/temporal  constraints.  The 
constraints  involve  collision-free  maneuvers  and  simultaneous  times  of  arrival  at  desired  target  locations 
(time-critical  operations) .  The  methodology  proposed  in  the  paper  built  on  previous  work  by  the  authors  on 
path  following  and  extended  it  to  a  very  general  setting  that  allows  for  the  consideration  of  complex  vehicle 
dynamics,  time-critical  specifications,  and  time-varying  communications  topologies.  In  the  setup  adopted, 
single- vehicle  path-following  control  in  3-D  space  was  done  by  resorting  to  a  nonlinear  control  strategy  derived 
at  the  kinematic  level.  Decentralized,  multiple  vehicle  time-critical  cooperative  path  following  was  achieved 
by  adjusting  the  speed  of  each  vehicle  about  a  nominal  speed  profile,  in  response  to  information  exchanged 
with  its  neighbors  over  a  dynamic  communications  network.  We  addressed  explicitly  the  situation  where 
each  vehicle  transmits  only  its  coordination  state  to  only  a  subset  of  the  other  vehicles,  as  determined  by  the 
communications  topology  adopted.  Furthermore,  we  considered  the  case  where  the  communications  graph 
that  captures  the  underlying  communications  network  topology  is  be  disconnected  during  some  interval  of 
time  (or  even  fails  to  be  connected  for  the  entire  duration  of  the  mission)  and  provided  conditions  under 
which  the  complete  coordinated  path-following  closed-loop  system  is  stable  and  yields  convergence  of  conve¬ 
niently  defined  cooperation  error  states  to  a  neighborhood  of  the  origin.  Flight  tests  of  a  coordinated  road 
search  mission  scenario  that  exploited  the  multi-UAV  cooperative  control  framework  exposed  in  the  paper 
demonstrated  the  efficacy  of  the  algorithms  developed.  Future  work  will  aim  at  extending  the  algorithms 
presented  to  other  kinds  of  vehicles  and  maneuvers;  e.g.,  quadrotor  UAVs  undergoing  complex  time-critical 
maneuvers  that  require  synchronization  of  attitude  and  position. 
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Appendix 


A.  The  hat  and  vee  maps  [43] 

The  hat  map  (-)A  :  R3  — >  S0(3)  is  defined  as 


(*)A 


0  —  X3  X2 

X3  0  —Xl 

—  X2  Xl  0 


for  x  =  [xi,  X2,  *3]T  £  R3.  The  inverse  of  the  hat  map  is  referred  to  as  the  vee  map  (-)v  :  S0(3)  — ¥  R3.  A  property 
of  the  hat  and  vee  maps  used  in  this  paper  is  given  below: 

tr  [Mix)'']  =  -x  ■  (m  -  Mt)  V  ,  (45) 

for  any  i£l3,  and  M  £  R3x3.  We  refer  to  [43]  for  further  details  on  the  hat  and  vee  maps. 


B.  Proof  of  Lemma  1 


We  start  by  noting  that  over  the  compact  set  S2C  introduced  in  (20)  the  following  upper  bounds  hold: 

IMI  <cci  <-^=, 

<f{R)  <  c2  <  i  . 

Consider  now  the  Lyapunov  function  candidate 

Vpf(pF,R)  =  y(R)  +  Li\pFf . 

ci 


(46) 

(47) 


This  function  is  locally  positive-definite  about  (pf,Ru)  =  (0, 1)  within  the  region  Qc  defined  in  (20).  Moreover,  we 
note  that  |)e^||  can  be  related  to  the  function  4/(R)  as  follows: 

IM2  =  \  (ft 2  +  Ria)  =  \  (i  -  Rii)  =  \  (i  -  Rn)  (i  +  Rn)  =  9(R)  (i  -  ®(£))  • 

Then,  the  bound  in  (47)  implies  that,  inside  the  set  f2c,  the  Lyapunov  function  Vpf  can  be  bounded  as 


\\eF 


+  —  Ib-HI  <vpf< 
C1 


(48) 
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From  equations  (1)  and  (5),  the  time  derivative  of  Vpf  is  given  by 


Vpf  —  e_f 


^  ^  —  LIhT?  (^Rf  +  \v>d/f)d^  ^  Pf  '  ^  ^  —  Up/i  x  Pf  +  v  wi^j  . 


The  rate  commands  (15),  together  with  the  law  (14)  for  the  rate  of  progression  of  the  virtual  target  along  the  path, 
lead  to 

Vpf  =  -2Kk  eft  •  ek  +  ^  [~Kt  ( pF  ■  t)~  —  pF  ■  (ujf/i  x  pf)  +  vpF  ■  (m  -  (wi  •  t)  t)^  . 

Since  ( pf  ■  t )  =  if  and,  moreover,  we  have  that  (j>f  ■  ( 0Jf/i  x  Pf))  =  0,  then  (49)  reduces  to 


Vpf  =  -2  Kk  ek-ek-  -J-x%~  +  -j  (pf  ■  (K  -  (»i  •  i*)  0)  ■ 

Li  Li 

Letting  px  (t)  denote  the  cross-track  error,  which  can  be  expressed  as 

Px  =  (pf  •  m)  m  +  (pf  •  n2)  n2  =  tjf  m  +  2f  ^2 , 

we  have  the  following  equality: 

Pf  ■  (uTi  -  (wi  ■  t)  t)  =  pf  ■  ((wi  •  m)  m  +  (m  •  n2)  n2)  =  px  •  wi  • 

Substituting  (52)  into  (50),  we  obtain 

T y  0  tv'  27Q  2  ,  2v  .  _  . 

Vj>/  =  -2^h  ek-ek-  -p-Xf  +  -j  (Px  •  wi)  ■ 


(49) 


(50) 

(51) 

(52) 

(53) 


Consider  now  the  quantity  (wi  ■  bio),  which  represents  the  cosine  of  the  angle  ipe  between  the  desired  direction  of 
the  velocity  vector  bio  and  the  actual  direction  of  the  UAV’s  velocity  vector  wli.  From  the  definition  of  4^(7?)  in  (3), 
we  have  that 

Wi  ■  bio  =  cost pe  =  i?n  =  1  —  24>(7?) . 

The  bound  in  (47)  implies  that,  within  the  set  fic,  the  quantity  (wi  ■  bio)  is  bounded  away  from  zero: 


wi-biD**!-  24^(7?)  >  1  -  2c2  >  0  . 


The  quantity  -  - —  is  therefore  well  defined  within  the  set  flc.  Next,  we  add  and  subtract  the  term  -3( 


2v  (pX  b1D) 


(i3l-6iD) 

to  (53)  to  obtain 


C1  (™1'Nd) 


Vpf  —  2,Kk  ek  ■  ek  2  xf  + 


2Ki  2  2v  (px  ■  bio)  2 v  px  ■  (m  x  (wi  x  bto)) 


ci  (wi  ■  bio)  ci 


(wi  ■  bio) 


The  definitions  of  bio{t)  and  Px{t)  in  (2)  and  (51)  lead  to 

T y  _  r,  rs  2Ke  2  2v 

Vpf  —  —2Kk  ek  ■  ek  —  2  Xp  — 


,  2 v  px  ■  (wi  x  (m  x  bio)) 

- - Y  Px  '  Px  H - 2 - ~ — 1 - ’ 

cl(vh  ■  bio)  {d2  +  px  ■  Px)2  Cl  {wi- bio) 

Next,  we  note  that,  within  the  set  fic,  the  following  bounds  hold: 

0  <  1  -  2c2  <  (wJi  •  bio)  <  1 ,  ||px  ||  <  ||pf||  <  cci  . 

These  bounds,  together  with  the  assumption  on  the  UAV  speed  in  (16),  yield  the  following  bound  for  Vpf. 

—  V,  ir  i  i  n 


■  ^  orx  „  l|2  2 Ke  2 

Vpf<-2KR\\eR\\  - +c2(1_2c2) 


||Px ||  ||wi  X  (mi  x  fojD)|| . 


ci(d2+c2dy- 

The  term  ||wTi  x  (wi  x  bio) ||  represents  the  absolute  value  of  the  sine  of  the  angle  ipe.  Therefore,  we  can  write 
IK  x  (■ w 1  x  bio)\\  =  |sin(V>e)|  =  \Jl  -  cos2 (ip e)  =  \Jl  -  R2lt  =  \J R\2  +  Rj3  =  2||e^|| , 

which  yields 


■  n9  2Ke  o 

Vpf  <  — 27sT^||e^||  ~2~xf  — 


2vn 


cl{d2+c2d)  * 


-  IIpx 


cf  (1  —  2c2) 


IIPxll  ||eA||. 
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Letting  Kp  =  min  <  Ke  , 


t  f  and  noting  that  ||px  ||  <  ||pf||,  we  have 

(d2+c2c^)  ^ 


Vp,  <  -2Kn\\enf  - 


'll  Pf 


+ 


4un 


cf  (1  —  2c2) 


IMI  llei 


From  the  choice  for  the  characterizing  distance  d,  and  the  path-following  control  parameters  Ke  and  in  (17)  and 
the  definition  of  A *f  in  (19),  it  follows  that: 


Kr 

Umax 

r  i 

0 

i 

c2(l— 2c2) 

Kp 

>Kf 

0 

c'f(l-2c2) 

"=T 

ci  J 

which  implies  that,  within  the  set  fic,  the  following  bound  holds: 

Vpf  <  —  2Ap f 


ea\\  +  2  IIpHI  )  —  2Ap/lp/ . 

ci 


1  —  6 


It  follows  from  [55,  Theorem  4.10]  that  both  ||e^||  and  ||pf||  converge  exponentially  to  zero  for  all  the  initial  conditions 
inside  the  compact  set  flc.  □ 


C.  Proof  of  Lemma  2 

First,  we  show  that  the  rate  commands  qc{t)  and  rc(t)  are  bounded  for  all  (pF,eF)  £  S2C.  Over  the  compact 
set  flc,  which  was  introduced  in  (20),  the  following  inequalities  hold: 

IIpfII  <  cci  ,  (54) 

$(&)  <  c2  .  (55) 

The  first  inequality  above,  together  with  the  bound  on  the  UAV  speed  in  (16),  implies  that  l(t)  satisfies 

K  I  ~  Umax  T  Ke  CCl  . 

From  the  assumption  on  the  feasibility  of  the  path,  we  can  conclude  that  both  parameters  k\(£)  and  k2(i)  are  bounded, 
and  therefore  the  bound  on  £{t)  implies  that  ujFn(t)  is  also  bounded.  It  then  follows  from  (6)  that  pF  is  bounded, 
which,  along  with  the  inequality  in  (54),  implies  that  the  entries  of  Ro(t)  are  bounded.  From  the  kinematic  equation 

({^£>/f}o)  =  r¥rfd  , 

it  follows  that  u}£>/F(t)  is  also  bounded.  Moreover,  (55)  implies  that  the  attitude  error  eF(t)  satisfies 

IM<c2. 

From  the  bounds  on  u. ’F/i{t),  w d/f{£ ),  and  eF(t)  it  follows  that,  for  all  (pF,eF)  £  the  rate  commands  qc(t) 
and  rc(t)  are  bounded.  Then,  based  on  the  assumption  made  in  Section  II. C  on  the  tracking  capabilities  of  the  UAV 
with  its  autopilot,  we  have  that,  for  all  (pF,eF)  £  fic,  the  following  performance  bounds  hold: 


l<?c  -  q\  <  7?  , 

| rc  -  r|  <  7r  . 

Next,  we  consider  again  the  Lyapunov  function  candidate 

vpf(pF,R)  =  *(R)  +  4  IIpfII2. 

ci 

From  equations  (1)  and  (5),  the  time  derivative  of  Vpf  is  given  by 


(56a) 

(56b) 


Vpf  =  et 


^  ^  —  Lliji?.  ^ Rp  {Wf/;}f  +  {Wd/f}d|  j  +  ^2  PF  ’  ^  ^  _  W F/I  X  Pf  +  V  Mlj  . 


-  n«i? 

We  add  and  subtract  the  term  eF  ■  [  ]  to  the  above  equation  to  obtain 

Vpf  =  ' 


^  ^  —  IIf/P  ^ Rf{lof/i}f  +  {c£d/f}.d^^  +  ^2 'Pf  •  (^—£t  —  ujf/j  x  pF  +  uwij 


9c  -  q 

rc  —  r 
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Similar  to  the  proof  of  Lemma  1,  we  have  that,  inside  the  set  f2c,  the  following  bound  holds: 


Vpf  <  -2A */  ^  _  c2  ||ejj||2  +  ||pf||2^  +  ||e^| 


Qc~q 
rc  —  r 


where  \*f  was  defined  in  (19).  From  the  performance  bounds  in  (56)  and  the  definition  of  7^  in  (22),  it  follows  that 

<  7^  , 


5c  -  q 
rc  —  r 


which  leads  to 


Vpf  <  -2A lf  ^  _  c2  ||e^||“  +  -j  ||pf||2^  +  ||e^||7a;  ■ 


We  now  rewrite  the  above  inequality  as 

1  „  j,  2  1 


VPf  <  -2(A*pf  -  <5x)  (^y— ^  ||eA||  +^2  \\pf\\~  )  ~  2Sx  ^ \  _  c2  lleall  +  ^2  IMI  J  +  Ile«ll7^  , 
where  0  <  S\  <  A *f.  Then,  for  all  Pf(1)  and  e^(t)  satisfying 


-2<5a  (  T-^7  lle^ll2  +  4  lbs’ll2  )  +  Ileflll7w  <  0 , 


1  —  6 


(57) 


we  have 


Vpf  <  -2(\;f  -  Sx)  IMI2  +  1  IIpfII2)  <  -  aA)vp/ . 


The  inequality  in  (57)  is  satisfied  outside  the  bounded  set  D  dehned  by: 


D  =  {  ( pF,R )  el3x  S0(3) 


1  /„  „  (1-c2)7.\2  ,  1  „  || 2  „  (1-c2)72 


i-c2  V"^" 

The  set  D  is  in  the  interior  of  the  compact  set  F  given  by: 


+  -jibFir  < 


16*2 


F  =  l  (pF,  R)  G  R3  x  S0(3) 


1 


2  ,  1  ||2  (1  —  C  )  7u 


4*2 


which  in  its  turn  is  contained  in  the  compact  set  Qb  dehned  by: 


Qb  =  i  (pF,R)  gR3  x  S0(3)  |  'k(R)  H — 7 lbFll  < 


2^(1-  c2h> 


4*2 


Then,  the  design  constraint  for  the  performance  bounds  79  and  yT  in  (22)  implies  that  the  set  Qb  is  in  the  interior  of 
the  set  12c  introduced  in  (20),  that  is,  fib  C  llc. 

With  the  above  results  and  using  a  proof  similar  to  that  of  Theorem  4.18  in  [55],  it  can  be  shown  that,  for  every 
initial  state  (pf( 0),  77(0))  G  12c,  there  is  a  time  Tb  >  0  such  that  the  following  bounds  are  satisfied: 

Vpf(t)<Vpf(0)e-2^f-s^, 


v  (l~c2h2 
Vpf(i)  <  4« 


V  0  <  t  <  Tb  , 

V  t  >Tb . 

The  bounds  in  (23)  and  (24)  follow  immediately  from  the  two  bounds  above  and  the  inequalities  in  (48).  □ 

D.  Proof  of  Lemma  3 

To  prove  ISS  we  first  show  that  the  homogeneous  equation  of  the  coordination  dynamics 

m = mm  m 

is  globally  uniformly  exponentially  stable  (CUES).  To  this  end,  we  first  consider  the  system 

(j>{t)  =  —aL{t)4>{t) ,  (59) 

where  a  is  the  proportional  coordination  control  gain  introduced  in  (28).  Letting  D(t)  be  the  time- varying  incidence 
matrix,  L(t)  =  D(t)  DT  (t),  we  can  rewrite  the  above  system  as: 

^(t)  =  -a(QD(t))(QD(t))Tm- 
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Then,  since  QD(t)  is  piecewise-constant  and  in  addition  we  have  that 

\\QD(t)\\2  <n, 

one  can  prove  that  the  system  in  (59)  is  CUES,  and  the  following  bound  holds: 


with 


<  k\ 

k\  =  1 ,  and  7a  >  7a  = 


7X* 


anfi 


(1  +  anT)2  ' 

This  result  can  be  proven  along  the  same  lines  as  Lemma  5  in  [56]  or  Lemma  3  in  [57].  Since  L{t )  is  continuous  for 
almost  all  t  >  0  and  uniformly  bounded,  and  the  system  (59)  is  CUES,  Lemma  1  in  [57]  and  a  similar  argument  as 
in  [55,  Theorem  4.12]  imply  that,  for  any  C3  and  C4  satisfying  0  <  C3  <  C4,  there  exists  Pc  0  ( t )  =  P^(t),  such  that 


S1"-1  * 


PCQ  ( t )  -  aL(t)Pca  ( t )  -  aPCQ  ( t)L(t )  <  -  c3In_i  . 
Next,  we  apply  the  similarity  transformation 


z(t)  =  SfC(t)  = 


In—  1  0 

-±CTQT  In-1 

to  the  original  homogeneous  system  (58),  which  leads  to 


c(t), 


z(t)  =  ScF{t)S^z{t)  = 
Consider  now  the  Lyapunov  function  candidate 


where  Pc(t)  is  defined  as 


Pc(t)  ± 


—aL(t)  +  \QCCtQt  QC 
~^CtQtQCCtQt  -±CtQtQC 


Vc(t,z)  =  zTPc(t)z, 
Pco(t) 


z(t) 


(60) 

(61) 

(62) 

(63) 


0 


0  ^3-nIn—  1 

The  time  derivative  of  Vc  along  the  trajectories  of  the  system  (63)  is  given  by 


Veit)  = 


zT(t) 


PCQ(t)-aL(t)Pco(t)-aPco(t)L(t)+±QCCT  Qt  Pco(t)+±Pco(t)QCCT  Qt  Pco(t)QC-%nQCCT  Qt  QC 


CT  Qt  Pco(t)-%nCT  Qt  QCCt  Qt 


-2  f~nCTQTQC 


z{t). 


The  inequality  in  (61)  implies  that 
Vc  (t)  <  zT(t) 

Now,  letting 


z(t). 


a  >  0 , 


Ac  = 


7A 


b  =  2a\cn ,  *  =  *  =  g  (g  -  l)  ± 


(64) 


2  riy/n  +  1 

and  noting  that  || QC ||  =  1  and  Amin(C'TQTQC')  =  i,  one  can  use  Schur  complements  to  prove  that  the  inequality 
-c3I„_i  +  ±QCCrQrPco  (t)  +  £PC0  ( t)QCCrQr  Pco  ( t)QC  -  f  nQCCTQTQC 


C  Q  Pc0  (f)  -  f  nC  1  Q  1  QCC  Q 


-2f 3-nC"  Q  1  QC 


<  — 2AC 


C2ln-1 

0 


f Tn2CTQTQC 


holds  for  all  t  >  0.  Then,  for  the  choice  of  parameters  in  (64),  the  inequality  above  implies  that 


Vc(t)  <  — 2A czT(t) 


C2ln 


0 


f WcTQTQC 
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which,  along  with  the  fact  that  Pc  0  ( t )  <  C2I71-1  and  Amin(C,TQTQC')  =  ^  leads  to 


14(f)  <  — 2A czT(t) 


Pc0(t) 

0 


z(t)  =  — 2AC  Vc  (t) . 


Application  of  the  comparison  lemma  (see  [55,  Lemma  3.4])  leads  to  the  following  upper  bound: 

Vc(t)  <  Vc(0)e~2Xct, 

and  since  minjci,  |g-n}||2(t)||2  <  Vc(f)  <  max{c2,  fg-n}||2(f)  ||2,  we  find  that 

ll*(t)ll  < 


\  min{ci,  frn} 
The  similarity  transformation  in  (62)  implies  that 


(  max|c2,  Trn|  i  ,  , 


lic(f)ll  <  ns, 


_i„  / max{c2,  f^w} 
V  min{ci,  f|n} 


11*11  l|C(0) ||  e~ 


and  consequently  the  system  (58)  is  CUES.  Moreover,  since  7a  >  7a,  we  have  that 

A  =  7a  >  7a  =  anti _ 1  a  ^ 

2 riy/n  +  1  —  2ny/n.  +  1  (1  +  anT )2  2 n^/n  +  1 

We  conclude  that  the  forced  system  (30)  is  ISS  because  it  is  a  linear  system,  the  Laplacian  L(t)  is  bounded,  the 
homogeneous  equation  is  GUES,  and  the  speed  tracking  error  vector  ev(t)  is  assumed  to  be  bounded  for  all  t  >  0. 
This  implies  that  the  bound  in  (31)  holds.  The  constants  fci  and  &2  in  (31)  can  be  derived  from  a  proof  similar  to 
those  of  Theorem  4.19  and  Lemma  4.6  in  [55]. 

To  prove  inequalities  (32)  and  (33),  we  introduce  the  disagreement  vector  g(t)  =  II  £(t)  and  use  the  facts  that 


£ rv 

II 

1 

na 

i  =  1,  2, . . . ,  n\  j  =  1, 2, . . . ,  n , 

(65) 

lle(*)ll  =  IICi(*)ll. 

(66) 

C2 ,»(*)  =  ~  1 

i  =  2, . . . ,  n  . 

(67) 

It  follows  from  the  relationships  (65)  and  (66)  that 

I&C0-&C0I  =  <  |0*COI  +  I&COI  $  2lk(l)ll  «  2||Ci(t)||  , 

and  thus  equation  (31)  leads  to  (32)  with  /c3  =  2&2.  On  the  other  hand,  from  (27),  (29),  and  (67)  one  obtains 

£i(f)-l  =  (&(*)  “  &  CO)  +e'v,i(P) 

jeJi 

&(t)-l  =  -aj^(£i(t)  -  £j(t))  +  (2,i-i(t)  +  e'Vii(t),  i  =  2, 

jeJi 

which,  along  with  the  bound  in  (31)  and  the  fact  that  |ej,i(i)|  <  e”’! (f>  ,  lead  to  the  bound  in  (33)  with  A7  = 
(2a  (n  -  1)  +  1)  fc2  +  7^—  ■  □ 


E.  Proof  of  Theorem  1 

First,  in  order  to  simplify  the  notation  in  this  proof,  we  define  the  positive  constants  nCmm  and  vCmax  as  vcmin  — 
Vmin  +  7„  and  Vc  max  —  umax  —  Jv ,  which  — as  shown  later  in  the  proof  -  will  characterize  the  lower  and  upper  bounds 
on  the  UAV  speed  commands.  Similarly,  let  vd:i  mm  and  Vd.,%  max  be  lower  and  upper  bounds  on  the  desired  speed 
profile  for  the  ith  UAV,  vd,i(-),  that  is,  vd,i min  <  vd,i  <  Ud.im ax,  and  define  vd min  and  vdlnax  as 

min  =  mill  Vd,i  min  5 

iG{l,...,n} 

Ud  max  =  mB,X  Vd, i  max  • 

We  note  that  the  assumptions  on  the  initial  conditions  in  (40)  and  (41)  imply  that  the  following  bounds  hold  at 
time  t  =  0  for  all  vehicles: 

Vc  min  Vc,j  (0)  ^  Vc  max  ,  V  j  £  fl,  .  .  .  ,  77.}  . 
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In  fact,  from  the  assumption  on  the  initial  path-following  errors  in  (40),  it  follows  that,  for  all  j  £  {1, . . .  ,n}, 


l|PFj(0)||  <  cci  ,  (68) 

*(4(0))  <c2.  (69) 


Also,  from  the  proof  of  Lemma  1,  we  have  that 

wi,j  ■  biD,j  =  1  —  2 *(4)  i 

and  therefore  it  follows  from  (69)  that 

wi,j  (0)  •  bio,j  (0)  >  1  —  2c2  >  0  . 

This  inequality,  together  with  the  definition  of  bin,j  in  (2)  and  the  bound  in  (68),  implies  that 

_  ,  .  .  ,  d(l  —  2c2)  —  2cic2(l  —  c2)i 

(d*+c*cl)2 

From  the  choice  for  the  characterizing  distance  d  in  (35),  it  follows  that 

d(l  —  2c2)  —  2cic2(1  —  c2)^  >0, 

and  therefore,  we  have 

fn^  d(l-2c2)-2cic2(l-c2)i  _  „ 

u' i  j  (0)  •  tj  (0)  ^  i  ^  0 , 

(d2+C*4)2 


(70) 


which  implies  that  the  quantity 


is  thus  well  defined.  From  this  fact,  the  definition  of  the  speed  commands 


in  (26),  the  coordination  law  in  (28),  the  equalities  in  (65)-(66),  and  the  bounds  in  (68)  and  (70),  it  follows  that  the 
speed  command  at  time  t  —  0,  vc,j(0),  satisfies 


Vd,i  min  2(j(?7.  l)Ud  i  max  ||  C  (0)  I  KlCC\  Vc,j  (0)  ^  (Ud  i  max  T  2  Q,(n  l)Ud  i  max  ||  C  (0)  I  T  A^CCl)  , 

C2 

Then,  the  assumption  on  the  initial  condition  in  (41)  implies  that,  for  all  j  £  {1, . . .  ,n}, 


Vc  min  <Wej(0)<  Vc  max  • 

With  this  preliminary  result  in  mind,  we  now  prove  the  claims  of  the  theorem  by  contradiction.  To  this  effect, 
we  consider  one  of  the  UAVs  involved  in  the  mission  that  has  not  yet  reached  its  final  destination,  and  assume  that 
it  violates  the  results  of  the  theorem,  that  is,  either  it  is  not  able  to  remain  inside  the  prespecified  tube  centered  on 
its  desired  path,  or  its  speed  command  goes  outside  the  acceptable  feasible  range  while  trying  to  keep  coordination 
with  the  other  UAVs.  Without  loss  of  generality,  we  assume  that  this  UAV  is  the  first  one  that  violates  (at  least)  one 
of  these  conditions,  and  therefore  we  suppose  that  all  other  vehicles  do  satisfy  the  claims  of  the  theorem.  In  what 
follows,  we  establish  the  validity  of  the  theorem  by  showing  that  the  hypotheses  above  imply  a  contradiction. 

Consider  the  ith  UAV  and  suppose  that,  at  time  t  >  0,  it  has  not  yet  reached  the  final  destination  (that  is, 
<  1).  Assume  that,  at  this  same  time  instant  t,  either  the  path-following  errors  of  the  ith  UAV  are  such  that 
( PF,i{t),Ri(t ))  ^  flc,  or  its  speed  command  vc,i{t)  does  not  satisfy  the  bounds  ucmin  <  uc,i(t)  <  t)cmax  (or  both).  For 
all  other  UAVs,  we  assume  that  (pF,j(r),  Rj(r))  £  Q.c  and  t)cmin  <  ncj(r)  <  ucmax,  j  £  (1, . . .  ,n},  j  ^  i,  and  for  all 
T  £  [0,t]. 

Consider  first  the  case  in  which  (pF,i(t),  Ri(t))  ^  fZc,  while  vCmin  <  vc,i(r )  <  ucmax  for  all  r  £  [0,  £] .  For  the 
ith  UAV,  consider  the  same  path-following  Lyapunov  function  candidate  as  in  the  proof  of  Lemma  1: 

vPf,i(j)F,i,Ri)  =  *(4)  h — 2  IIp-f^I!2  • 


Since  (pf,i(0),  Ri(0))  £  S2C  by  assumption,  and  Vp/,i  evaluated  along  the  system  trajectories  is  continuous  and 
differentiable,  we  have  that,  if  (pF,i(t),  Ri(t))  ^  S2C  for  some  t  >  0,  then  there  exists  a  time  t1  (0  <t'<  t )  such  that 


while 


)  —  c  ! 

)  >  0  ! 

Vpf,i(r)<c2,  V  r  £  [0,  t') . 


(71) 

(72) 

(73) 
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The  equality  in  (71)  and  the  bound  in  (73)  imply  that  the  following  inequalities  hold  for  all  r  £  [0,  t(]: 

||PF,i(r)||  <  cci  ,  ty(Ri(r))  <  c  , 

which,  along  with  the  choice  for  the  characterizing  distance  d  in  (35),  imply  that 

wi,i(r)  •  ti(r)  >  c2  >  0  ,  V  r  £  [0,  t'], 

where  C2  was  defined  in  (70).  The  quantity  —  -  -  is  thus  well  defined  for  all  r  £  [0,T],  which  implies  that  the 

speed  command  vC}i(r )  in  (26)  is  also  well  dehned  for  all  r  £  [0,  t'].  Since  umin  <  #Cmin  <  vc,i{r)  <  nCmax  <  Umax  for 
all  r  £  [0,  t/]  by  hypothesis,  the  assumption  on  the  UAV  dynamics  in  (13)  implies  that 

\vc,i(r)  -  Vi(r)\  <  7„  ,  Vt£[0,/]. 


Then,  it  follows  that 

t^min  ^  Vi  (t)  ^  Umax  ,  V  T  £  [0,  t  ]  . 

We  can  now  use  a  proof  similar  to  the  one  of  Lemma  2  to  show  that,  for  all  r  £  [0,  i/] ,  Vpf,i  <  0  on  the  boundary 
of  which  contradicts  the  claim  in  (71)-(72). 

Next,  we  consider  the  case  in  which  the  bounds  vCmm  <  nc,i(t)  <  nCmax  do  not  hold,  while  (pF,i(r),  Ri(r))  £  Q.c 
for  all  r  £  [0,  £] .  Let  t!  (0  <  t’  <  t )  be  the  first  time  at  which  uCmm  <  vc,i  <  vCmax  is  not  satisfied.  Then,  we  have 
that  at  time  t1  one  of  the  following  bounds  holds: 

Vc  min  >  vc,i(t') ,  or  vc,i{t')  >  Vc  max  ?  (74) 

while 

Vc  min  <  vc,i{r)  <  Vc  max  )  V  t  £  [0,  t') .  (75) 

Since  (pgi(r),  Ri(r))  £  for  all  r  £  [0,  t']  by  hypothesis,  the  following  bounds  hold  for  all  r  £  [0,  t']i 

\\PF,i{T~)\\  <  cci  , 

4>(i?i(r))  <  c2  , 

which,  along  with  the  choice  for  the  characterizing  distance  d  in  (35),  imply  that 

wi,i(r)  •  U(r)  >  c2  >  0 ,  V  t  £  [0,  t'] .  (78) 

The  bound  in  (75),  along  with  the  assumption  on  the  UAV  dynamics  in  (13),  imply  that 

W,i{T)  ~  «*(t)|  <  7« ,  V  r  £  [0,  t')  ,  (79) 


(76) 

(77) 


which,  in  turn,  leads  to 


^min  <  Vi(r)  <  Vmax  5 


V  r  £  [0,  t')  . 


Continuity  of  Vi  and  the  bound  above  imply  that  Vi(t')  is  bounded,  and  therefore  l'i{r)  is  continuous  and  stays 
bounded  for  all  r  £  [0,  t'].  Since  we  have  assumed  that  the  ith  UAV  has  not  yet  reached  its  final  destination  at  time  t, 
we  also  have  that  <  1.  Then,  from  the  definition  of  the  coordination  states  in  (9),  it  follows  that  £i(r)  is  also 
continuous  and  bounded  for  all  r  £  Moreover,  since  (by  hypothesis)  the  bounds  vcmin  <  vc,j{r)  <  ncmax  hold 

for  all  j  £  {1, . . . ,  n},  j  ^  i,  and  for  all  r  £  [0,  t'],  it  follows  from  the  assumption  on  the  UAV  dynamics  in  (13)  that 


\vc,j(r) -Vj(T)\<jv  ,  V  j  £  {1,  ...,n};  j  ^i,  Vr£[0,t'],  (80) 

which  leads  to 

nmin  <  Vj{r)  <  Umax  ,  V  j  £  {1,  .  .  .  ,  7l}  ;  j  ^  *  ,  V  T  £  [0,  t']  . 

This  bound,  along  with  the  hypothesis  that  Rj(r))  £  flc  for  all  j  £  {1, . . .  ,n},  j  ^  i,  and  for  all  r  £  [0,  t'], 

implies  that  £j(t)  is  bounded  for  all  j  £  {1,  . . .  ,n},  j  ^  i,  and  for  all  r  £  [0,  t'].  Boundedness  of  £j(r)  for  all  j  £ 
{1, . . . ,  n}  and  for  all  r  £  [0,  t']  implies  that  uCOord,i(t')  is  bounded,  which,  together  with  the  inequality  in  (78),  implies 
that  vc,i(t')  is  also  bounded.  Hence,  we  can  conclude  that  ev,i(t')  is  bounded.  Then,  since  the  speed  tracking  error 
vector  e„(r)  is  bounded  for  all  r  £  [0,^],  a  proof  similar  to  the  one  of  Lemma  3  can  be  used  to  show  that  the  choice 
of  the  coordination  control  gains  a  and  b  in  (37)  ensures  that  there  exists  a  positive  constant  Xc  such  that 

IICMII  <  MC(0)||e~AoT  +k2  sup  ||e„(s)||  ,  Vr£[0,t'], 

s£[0,t) 


and  hence,  the  bounds  on  the  speed  tracking  errors  in  (79)  and  (80)  lead  to 

K{t')\\  <  MC(0)||  +  k2Vn'yv 
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From  the  inequality  above,  the  speed  command  in  (26),  the  coordination  law  in  (28),  the  equalities  in  (65)-(66),  and 
the  bounds  in  (76)  and  (78),  it  follows  that  the  speed  command  at  time  t' ,  vc,i(t') ,  satisfies 

Vd,i  min  ^d,imax  (MC(0)||  +faVii7»)  -  Kecci  <  vc,i(t')  <  d-  (vd  ,i  max  +  Vd,i  max  (fci||C(0)||  +  k^y/n^v)  +  Kecci)  , 

where  hi  and  were  introduced  in  (41)  and  (39)  respectively.  The  assumption  on  the  initial  condition  in  (41)  implies 
that 

+  <  vc,i(t')  <  t^max  5 

which  contradicts  the  claim  in  (74). 

Finally,  similar  arguments  can  be  used  to  prove  the  impossibility  of  both  (pf,;,  Ri)  £  and  uCmin  <  vc,i  <  Ucmax 
failing  to  hold  at  the  exact  same  time. 

Therefore,  we  have  that,  for  alii  £  {1, . . . ,  n}  and  for  all  t  >  0,  the  path-following  errors  PF,i(t)  and  Ri(t)  satisfy 

( VF,i{t),Ri{t ))  £  fic  , 


while  the  speed  command  vC}i(t)  verifies  the  bounds 

Vc  min  <  vCli{t)  <  V  c  max  • 

It  follows  from  the  bound  in  (81)  and  the  assumption  on  the  UAV  dynamics  in  (13)  that 
\vc,i(t)  -  Vi(t)\  <  ,  V  i  £  {1, . . .  ,n}  ,  Vf  >  0, 

which  leads  to 


^min  <  Vi(r)  <  ^max  j  V  Z  £{l,...,n},  Vf  >  0. 

Moreover,  the  choice  for  the  characterizing  distance  d  in  (35)  implies  that 

wi,i(r)  •  ti(r)  >  C2  >  0  ,  V  i  £  {1, ...  ,n}  ,  V  t>  0. 

Then,  the  bounds  in  (42)- (43)  and  (44)  follow  respectively  from  proofs  similar  to  those  of  Lemmas  2  and  3. 


(81) 


□ 
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